I noticed that the VIP option switches back to a very low diff every now and then, which results in a much lower hash rate.