For bitcoin you can Use electrum and for EVM or Ethereum Virtual Machine you can use metamask and save all the private key + Optionally add a hardware wallet to give more security on your wallet.

Metmask is flexible with any EVM chain Layer 1 and Layer 2 including top chain like bnb matic and other. + if you are using metamask never approve suspicious contract and you will be safe. yes, using binance as holding wallet is somewhat dangerous.