Solved by increasing rpcthreads. Thanks!  

One more question.
How do I check the total Khash/s I'm getting from all of my connected miners?  
I throwed a hundred of CPU core in to this.
But when I tried "gethashespersec" but it returned zero!?!?