Server A has client on it then point B to Server A and connect on that ip and port. So if Server a is for example 192.168.0.3 with client on it you would simply just put that in from server b or c or d to all connect to A if you are doing it over ISP ip address then you need to allow all ips in conf file and then point miners at it