But if I am guaranteed to get them within 5 hours, that I can live with and I will used the same fee.
There is no guarantee; if you decide to pay low fees, that is the risk you take.
It is rather annoying when you use a service that doesn't allow you to set a fee and it is below the recommended amount.