Now with the insanely large fees, I've just noticed that the size of a transaction done by the blockchain.info wallet is very large. Yesterday I sent 0.01 BTC to someone, the transaction had 4 input addresses and 2 output addresses, when I just wanted to send some bitcoin to one address.
The size was 667 bytes, and acording to bitcoinfees.21.co the median size is 226 bytes. Which means blockchain.info's transaction size is 3x as much as the median, which means 3x as much fee.