You don’t need a bank to store Bitcoins. With Bitcoin, YOU are your own bank. YOU have to take all the precautions to protect your funds (backup and password protection and safety). You could use a bank to store your offline wallet passphrase, though.