Miners can switch any time they want to switch.
The only time this is an issue is if 1 pool phsically has 52% of the gear in their mine on their pool.
That would be a true issue since they would truly control BTC.
until that happens do not worry be happy.