Yes, of course I am afraid of the hackers, I could not imagine how devastating I would be if all my bitcoins or altcoins are being stolen from my wallet when I wake up the next morning to check my wallet and saw all my bitcoins and altcoins missing from my wallets.
Try to keep money on the Ledger. This is an external device. The ego will be more difficult to break.