Ledger Nano S is one of the best options. You can create an ethereum wallet in Ledger Nano and ensure that it is safely password protected for taking out to exchange whenever you want.
I have never tried hardware wallets. But I think that this is the most reliable way to store your crypto assets. I think I should to buy it, too.