How many miners are you using? If you have many, then some might be unable to connect due to stricter firewall rules.

Some people suggested using appropriate miner with appropriate config.