Get a wallet where you can set custom fees of your choosing and you will be alright. The low/average/expedited options won't do the trick, you would need to input your own numbers.
When you withdraw from an exchange there is not thing you can do about it. Except wait! This sucks.