Ok experimented with affinity.  Oddly enough it does not change the hashrate of AMD cards.  It did however, drop my Nvidia's from 130MH or so to 6MH when I set affinity to one core.  No idea why.