What I say is simple: do not have Ledger Wallet installed on your PC; use Electrum or another wallet to access Ledger; and never do this type of configuration.
This is clear for anyone who wants to continue using their HW Ledger.
How safe is that against a thief who steals your Ledger and uses "Recover" to extract your seed phrase from the "secure" element?