It's not all that bad.  With the nfactor, you get about half of Litecoin scrypt mining hashrate on your GPU, which means a mid-high end GPU is only going to pull a few times that of a high end CPU.   Certainly not the 50x or 100x we usually see with scrypt, or the many hundreds of times with SHA256.