This is such an easy thing to overlook, especially to new people getting into crypto. We hear so many stories about sites getting hacked that its not worth the risk, personally I store mine using a ledger nano s and it works perfectly for my use case