You should usually keep it off exchange wallets since they may get hacked and lose your money. If you don't own the private keys to your coins, they're essentially not yours.
You definitely should use other wallets for your BTC/alt coins. Consider even buying a hardware wallet such as a Trezor or Ledger Nano seeing as you have 4-5K of crypto.