I've also heard that it was possible to hack, with physical access to the equipment, a Trezor. But there is no record that anything ever happened to a Ledger.
When you write it like that, it looks like it's a rumor, but the truth is that it's a proven fact and that any Trezor HW that is not protected with a passphrase or SD card can be hacked in 5 minutes with equipment worth $100. Of course, it is a physical attack, which means that the HW should be stolen/lost.
Ledger had its vulnerabilities, but as far as is known, they have all been patched, although the Ledger Leak is something that definitely seriously damaged the company's credibility. Someone who is in such a serious business should not allow such situations.