The Trezor with a sophisticated pin is even more secure than the Trezor with a secure element! Because it doesn't use these closed source Secure Elements, that can probably be readout by the companies that produces them, or by people who get their hands on the companies secret.
With a good PIN you can go open source and and also eradicate the risk that physical access brings, at the same time!
I would feel more safe loosing a Trezor secured with a 128 Bit PIN than one with a SE.
I agree about the PIN.
I use so small pin in my ledger. I will probably change that soon, as I am a bit worried about it recently.
I created those pin almost 10 y ago. I use 2 pin (as I have one hidden wallet with passphrase).
Poor thing that you use Ledger.