I think it is because of how many are currently doing transactions in the same time. Because a lot of of transaction needs to be done, it may take some time to get all those transactions to be done. Paying the lowest fees may also be the reason. Higher transactions fees ensures that your transaction will be much more faster than those who pay normal or low fees.