AFA losing access to your trezor, it doesn't matter, if you lose access to any wallet move your coins immediately!
You seem to be suggesting that it does not matter if the Trezor has a secure element or not?
If you lose physical possession of your trezor, then the coins should be moved?
I always considered the standard wallet (the one without a passphrase) to be a canary in the coalmine, if it were to get jeopardized first.
The idea is that, once you realize your Trezor (or other wallet) is gone, you use your seed backup to restore it (on a new Trezor or other device) and then immediately move your Bitcoin to a completely new wallet (with a brand new seed). Even if your PIN is not too strong, it should be strong enough to withstand a few hours or days of brute-force, so by the time the thief has cracked your PIN, your (old, stolen) wallet will be empty.
Of course, if you haven't used (3) and/or (4) below, the thief will still know that you have emptied the wallet, when you emptied it, and the amount of Bitcoin moved, so be prepared for a $5 wrench attack soon after...
My advice:
1. Keep a low profile -- don't advertise your coins.
2. Always use a PIN.
3. Always use a strong passphrase.
4.
Plausible Deniability (it's easier than it seems).
5. Protect your Trezor (or other wallet) as if it were cash -- never lose physical access to it.