I fully agree with this, this is something I do few years ago, and I can say I sleep somewhat better from then, but still there are certain things around which the owners of hardware wallets need to worry.

First is for sure proper backup of seed, which many actually ignore thinking it's just enough to buy HW and transfer coins to device. Second thing is to be careful with fake software (fake Ledger Live or fake Trezor sites), which aim to to steal user seeds by deceive them to enter seed in such fake software, and seed should be only entered to hardware device and nowhere else.

What also should not be ignored at this point is the fact that hardware wallets are safe today, but given the number of devices sold, and value which is store on them, we can bet that hackers working non-stop on the way to hack them. We can only wonder whether they will ever succeed, or this way of storing cryptocurrency will remain 100% safe forever.