Thank you all, I'm not sure but I think it's overheating and it probably started slowing down when I swapped the fans.
I still can't figure out the difficulty thing: isn't it slower to process more difficult hashes than easier ones? If it is, what does the 1TH/s speed refer to?
If it doesn't, why bother about difficulty at all?