Bitcoinqt can clog up your bandwidth.
I know that my gaming servers ping goes from 300ms to 29ms after I close bitcoinqt
I've also has this issue. So the question is am I using that much bandwidth, or is my ISP throttling me?
This affected me during initial sync only. Do you experience it after your initial sync?