In theory when people do that we solve enough additional blocks for the payout to stay the same over a given time period.  There's still some luck involved, but the more hashing the pool gets, the more stable the payouts should be.  So I guess the more the merrier.    At least until the server falls over.  heh.