Most likely you have something wrong going on with the system. It could be caused by so many things, it's impossible to make any suggestions other than monitoring it closely to find out what it is.

Are your cards cool enough so they don't throttle?
Are you load/balancing with another pool?
What's your ping? Your connection might be dropping.

--
No idea about nvidia versions bcboy.