Yes, unfortunately. If you want to be able to have an offline wallet that will never expose your private key online, you could create a watching-only wallet (online) and the actual wallet on an air-gapped computer. You create a transaction using your watching-only wallet, sign it with your air-gapped wallet, then broadcast it with your watching-only wallet. Electrum has a tutorial here.

Electrum only works with Bitcoin, unfortunately, but I'm pretty sure there are modified versions specifically made for some alts. I can't vouch for their safety and security though.

Alternatively, hardware wallets make sure your private keys never leave the device, so that's the most straightforward solution available.