Most part should be stored in a Wallet. If you want to trade you should have some in an exchange
If your purpose is to buy and hold, a wallet would be the best choice.. If your purpose is to trade with different currencies, then obviously and exchange would be most convenient.