Hm... What if someone get holds of your Trezor without your knowledge, installs malicious firmware that saves your passphrase, returns it to you, then steals it again after you have used it, and downloads the pasphrase? Or whaterver?
You have to confirm that you want to run it with unsigned firmware every time you plug it in.