Now transaction fees are just going up

Indeed they are. Sadly, like Plaguedeath said before, there is not much you can do since you can't use CPFP and RBF on the transaction. There are only two options : either wait for the transaction to be confirmed (usually in the weekends the fees are lower) or pay the premium of a accelerator...