I agree with you, if we holding coin on the exchange will be many risks like coin hack, exchange stopped and other problems.
I recommendation use hardware wallet like ledger or trezor because of high security.
But you must keep the 24-word seed to recovery.