Sometimes when I withdraw BTC to my wallet, I set really low fees like 50-70 satoshi per byte and wait for weeks, because I'm not going to spend those coins in the near future anyway. I think it's a good way to save a bit of money, because if you look back, you might realize that your fees have added up to a big amount in USD value, while it wasn't always necessary to get those coins confirmed asap.
So, do you use low fees, or always want to get confirmation in a next few blocks?
As long as your bitcoin received than it doesn't matter. I don't use small fees, just a sufficient amount to get my transaction confirmed but normal fees still have to wait for several days due too many unconfirmed transaction on waiting list. Well, I don't mind to pay 120-200 satoshi per byte, but some people suggest to increase fees until 220 satoshi.