I've never tried importing 24 seed words into Electrum
It works normally.
OP, the seed phrase you Ledger generated will be BIP39, whereas Electrum seeds not BIP39, as explained by Charles-Tim above. When you try to import your seed phrase to Electrum, on the screen where you type your seed phrase in you need to make sure you click the "Options" box and check the box marked "BIP39 seed".
If this isn't working, then Electrum might give you a clue as to why it is not working by saying something like "checksum: failed". Is there any chance your words might be incorrect, have one or two misspelt, be in the wrong order, etc?