I haven't experienced any issues like that.  You could try running it with the -debug option and see if anything interesting is posted to the debug.log when you have the problem.  My experience has generally always been very strong connectivity, stronger than other coins usually... I know there were a few hundred peers connected on one of the nodes when I checked yesterday (I have it upped over 125).