I`m trying to send a small amount of BitCoin via electrum wallet to my hardware wallet & i`m getting about 40% fee.

I then adjusted the fee paid bar left to the max & its lower but still high  saying - "the fee for this transaction seems unusually high 5.06%".

For comparison I transferred about $300 at the weekend from an exchange to hardware wallet and was charged less than $1.

Is this an electrum thing? is there anything else i can do?, as far as i know i only have one active address in my wallet

Thanks