AFAIK, there's this Dencun upgrade that has happened for Ethereum lately. And that is about the decreasing of fees. I don't know why you've been asked for a $120 by that wallet of yours for a $10 worth of ETH to transfer. Gwei(gas fee) right now is around 47 and it's likely $1 but if this is a wallet that's from a dex then it's about the commission that they're getting. One thing that you can do is to always monitor the gas fees and check it out if the fees are acceptable to you to do the transfer.
Maybe the gas limit is very high?
I stopped using Ethereum years ago. At the time when the gas fees were too high. It only favored those with big amounts of Ethereum or tokens to transfer, and not small accounts. Instead of having headache trading ERC20 tokens on Ethereum chain. Try alternative cheaper chains like BSC and Solana (which has become quite popular lately)