LL has a history of bugs, of adding more advertising before fixing the bugs and that's not good. I also expect Ledger as company keep an eye on what funds everybody has, where possible (exactly in the same way some Electrum servers do). But I've got used with Electrum, it does everything I need almost in the way I want it, so that's what I use.
And Electrum server can be installed locally too, so if one doesn't travel, he can have a good mix of protection (HW) and privacy too (local server) with this setup.