if you are concerned with security there are two options that I would recommend

Hardware wallet such as ledger nano (stores bitcoin and altcoins)

Cold storage a computer that is air gapped (no internet connection) https://www.ledgerwallet.com/products/ledger-nano-s

Paper wallets (private key is printed out) https://bitcoinpaperwallet.com/