There are some closed source non-custodial solutions. OWNR, for example, is not storing the keys. And as i know there were some security problems with Electrum in the past https://cointelegraph.com/news/electrum-faces-another-fake-wallet-attack-users-reported-to-lose-millions-of-dollars