Theoretically, you should be able to setup your Ledger with Electrum... then sweep the UTXOs directly to your Ledger without needing to import them or create other wallets.
When you created the paper wallet did you also derive all 3 address types from the one private key and then sent coins to those addresses over time?
I have a p2sh SegWit BTC paper wallet and need to move it all in one transaction to a Ledger hardware wallet. I need to get it off paper and into a proper, secure BIP39 wallet. This is over 30 inputs and a mix of all 3 formats (Legacy, SegWit and Native SegWit) with a total raw data size of well over 30,000 bytes. This is also a life-changing amount of BTC.
If you don't mind me asking... how did you end up with a mix of input types when you have "a p2sh SegWit BTC paper wallet"? When you created the paper wallet did you also derive all 3 address types from the one private key and then sent coins to those addresses over time?