Thanks LoyceV.

I had a Ledger Nano a few years back and almost lost a lot of Satoshis because it could not handle the "dust" (small regular deposits) from my mining rigs and would never stop syncing. I was finally able to recover my sats using Electrum with my passphrase but that whole debacle scared me off of cold wallets (and even more now with Ledger's email database being hacked).

The question remains can I connect Electrum to my node without using one of the Electrum servers?