Ok. I understand now.
With that understanding though, I refer back to my point of fraud. What, then would stop someone from selling the wallet to 3 different people where only one will be able to use it?
I would suggest reading through this thread. There's a lot of information from one of the co-owners of the company that makes them.
In short, there is only one physical wallet so how could you physically give it to 3 people?
The hardware wallet is contained in an NFC chip on the card that is encrypted. The balance can be verified using an NFC enabled smartphone. That's why you don't need trust, you can verify the card you have been given is funded.