First of all, to answer your question, you have to ask yourself how much you want to invest/how much you have. If you think your holdings are much valuable consider buying an hardware wallet (the physic one as you said) like the Ledger Nano S (https://www.ledgerwallet.com/products/ledger-nano-s?gclid=Cj0KCQiAuP7UBRDiARIsAFpxiRIvz4rN4dqOmEaS0q6HtydM2KLLwtrzzQ_vQQ-QuVnxk3h8-C8KiTgaApePEALw_wcB) that cost roughly 95€ on the official site. The pros of having an hardware wallet is that hackers can't access it, since it's not directly connected to the internet, but in case of extreme bad luck you could always risk connecting it to a PC infected by malwares, since these can activate applications/processes without your acknowledgment. So this is the safest choice, but the price is also considerable.
The other option is to use software wallet (they need installation on your PC) like I do since I don't own too much, the first I used is "Exodus", very complete/simple to use. But lacks of variety of crypto you can store.
Other options are mobile wallets like Eidoo (that I use) or Jaxx. They can store even ERC-20 tokens, it's something Exodus can't do.
The fourth and last possibility is to use a web wallet, like Dogechain (to store DOGE) or Raiwallet to store Raiblocks, but since they have rebranded to NANO the site is changed, it's https://nanowallet.io . These sites allow you to avoid installing anything, since you will use an online free service. But be conscious that you MUST prefer sites that allow you to hold your private keys, so that only you have access to your wallet (in case you lose the password or the site gets hacked). Exodus and the other software/mobile wallets will allow you to take possession of your private keys, with a alphanumeric code or with a mnemonic phrase.

Hope the answer it's clear. I'm here to learn too, so if anyone wants to correct something please feel free to do so.