When mining scrypt, you need 1 core on your CPU "available" to get your best hashrate.  It doesn't seem like it should be that way, but I discovered that when I was trying LTC on the GPU and CPU at the same time.  The loss of 1 core on CPU was trivial compared to the hashrate lost on the GPU.