You can check your other running processes too, and see if something else is registering a noticeable amout of CPU usage. Either Task Manager for Windows or top / nmon for *nix should work just fine for the task. Any %CPU used that isn't attributed to bitcoin/bitcoind is going to slow your hashes, even if it's only taking 5% of a core's processing muscle away from bitcoin.