For me personally, it is a greater danger to use that hardware wallet at all than this danger that they warn about.
It is surprising how people are still using it. Though I doubt many are really aware of it's dangers.
I'm not going to defend this company that screwed up again, but I would like to clarify, if ledger has the ability to access all generated seeds, then what prevents them from stealing the contents of all their customer's wallets? Are they waiting for the best moment? Waiting for more users to become their "victims"? Until there is evidence (facts) of their abuse of their position, it is impossible to say for sure (about access to all generated seeds) and all our suspicions remain just suspicions.
You check out this thread
Ledger Recovery - Send your (encrypted) recovery phrase to 3rd parties entitiesWhere there was some backing to this claim that they could access users seedPhrase.
Not go mention not really an Open sourced wallet.
Until the Ledger is caught red-handed
One doesn't have to be shot to know that a bullet in the head can kill.