Usually fees are lower on Sunday nights, so probably that would be the best time to buy Bitcoin and send it to your own wallet immediately.
But other than that probably the best time is when you have some extra fiat.
Never noticed that, but will pay more attention next time