Aren't the components still black boxes? I've seen more discussion about potential bias in dice rolls than about potential problems with hardware wallets.
The fact that it's always recommended to buy directly from the manufacturer makes me think there's a lot of trust involved.