So say I had 50 machines running around 200 TH total. Each with its own instance of cgminer running. Would a single wallet handle that or would you separate them?

Just curious as I was going to set up a pool for internal use but not sure if this way is better it seems there is less latency with directly talking to bitcoind with the miners  vs using pool software.