Of course it is scary when you don't own your private key because you may lost everything, that's why you must choose a non-custodial wallet in order for you to be safe. I suggest everyone to store their coins in a paperwallet for a much secured wallet.