The wallet that you will use depends on the kind of altcoin that you are talking about holding, if they are erc20 tokens then a wallet from a website like myetherwallet would be the best way for you to go. With some altcoins though, the creators provide their own wallets along with the coins so you would have to get the wallet from them to safe guard your coins