Setting/customizing fees doesn't mean you'll control the exact duration your transaction confirmation will take, you can of course customize your fee and target blocks you think your transaction will be confirmed in, but the network might be clogged and people's transactions paying more fees come in and you have to wait a little while more.