Bitpay isn't the most Bitcoin friendly service. If you take custody of your BTC with a wallet that allows you to set the fee amount and consolidate your inputs during low transaction periods you will not have such an issue with high fees.
I never realised this was possible. Which wallet service?