Well, this is at least one reason why you should use failovers or just user other pools. When a large number of miners are trying to connect to a single pool some of the connections can get stuck.
Ah yes I see.... okay, good advice. Will do that next time.