Are you on WiFi or Ethernet?
If you have a bunch of rigs, and they are all close together, you will get dropped connections with WiFi. The gpus cause all kinds of interference.
I had this issue and had to get a network switch and use the Ethernet for all the rigs and the problems went away. See if that is the issue.