Are you really sure that you never did something wrong such as entering your private keys to a form just to claim an airdrop or free token?
I checked my wallet that's stored on my nano ledger s and it's still there. It's impossible that someone will transfer your funds without knowing the private key. Did you just bought a second hand ledger nano s and its private keys were already generated? didn't you reset it?