I prefer a wallet that has secure backup, the back up should be encrypted to avoid hacker on having access of the account. This will allow the user to restore a wallet without having to type in your seed the password will be enough, and the QR code of the seed doesnt even need to be displayed on the screen of your device. This can provide defense against malicious software trying to capture the screen of your computer or smartphone. Wallet such as HODLER possess this feature and it really an effective way to keep from any act of hackers.
I totally agree with you about that sometimes we should be careful when we are trying to access our account even if we are in our homes or using public computers and aside from don't leave your account opened so that all your important files will not be accessible by someone.