It will be fine I don't own bitcoin than to live in such a situation because of an announce by Ledger and the FUD it created. If you don't feel compromised before the Ledger recovery service implementation, why will you feel so unsafe.
I personally don't feel unsafe and still use my Nano S together with a Trezor but for different purposes. I understand why the announcement of Ledger's seed sharing scheme left such a sour taste in everyone's mouth. At least they were "kind enough" to tell us what they are planning. The reactions would have been five times worse if they just implemented this in the background without telling anyone.
If there is a way to send keys from a secure element chip over the internet (when we were told it can't be done), how can we possibly trust everything else we supposedly know? And even if there is trust, how can we know that the implementation is bulletproof and won't result in a serious breech in the future? Even if it's the safest thing on the world, why would I want to have that on my hardware wallet? It's an endless loop of questions people have started asking because they can't believe what is happening.