The safest way for Bitcoin you have to use hardware wallets like Ledger, Ledger is one of the most famous hardware purses among lovers of cryptocurrency, The price is not too expensive.
I agree with you, using hardware wallet may be safer to store every asset we have, even more bitcoin. and I think in some reputable exchangers we can buy bitcoins.