Are you sure that there aren't any processes running that are temporarily using a lot of CPU? Saturating the CPU will cause a hit to hashrates of about that size.
Backup program, software update, trojan, anything? Watch task manager through one of the cycles and see if something is misbehaving.