I think you already have your answer from your experiences.

It is impractical to use BTC for small and immediate payments. You can still use it as a currency for larger transaction where $5 transaction fees can be considered as minimal. Fees over the weekend are still cheaper so it can also be used for advanced payments ^{[your payment is due next Tuesday? send on Saturday]} or in situations where the merchant is willing to accept late confirmations.