Indeed, Ledger had some problems in past, adding new coins, upgrading to the new firmware and limited space on devices, but never had problems with security.
Trezor had some problems regarding security... www.wallet.fail is an example.

Anyway. I have both wallets - cheap ones - and I'm very glad with them and I'm feel safe enough