They are also forcing firmware update that includes this ''feature'' so you can't escape this if you are using ledger nano X (for now).
This is what ledger co-founder aka reddit moderator btchip said:
Can we ever trust what people from Ledger say anymore?
Only a few months ago, they claimed something completely different.
Tweet by Ledger from 6 months ago:
Hi - your private keys never leave the Secure Element chip, which has never been hacked. The Secure Element is 3rd party certified, and is the same technology as used in passports and credit cards. A firmware update cannot extract the private keys from the Secure Element.