I think you've got the answer to your own question.
Don't just look at the growth of bitcoin without taking into account the risks it brings. Your home doesn't increase in value, but at least it's safe for you and real estate is considered the safest asset. For bitcoin, it might give you 3 other houses but could make you homeless in the future.
Don't and absolutely must not do that, invest with money that can be lost and make sure it doesn't affect your family's life.