If you are deported & lose your hardware wallet & seed phrase, your bitcoins are effectively inaccessible. Without the seed phrase, there is no way to recover your wallet, harsh but fair & reality..
I see a lot of people talking about brainwallet or having encrypted cloud backup, using these is the same as using an exchange.
What I think you can do is back up your seed phrase, write it down & store it in multiple secure locations, such as a fireproof safe or a trusted family members home. You can also use a multisig wallet, services like Bitkey offer multisig wallets where you hold two keys & a third party holds the third. You may also want to consider giving a trusted person power of attorney to manage your crypto assets in case of a legal emergency. You may also want to consult with a legal professional about your rights & options for accessing your assets after deportment.
The bottom line is, note your keys, note your coins.