You can't see the fact it says "Warning: Trade with Extreme Caution!" underneath his name?
It only said that after I left negative trust after he took my money. There was no negative trust beforehand...
but thanks a lot for pointing that out
You leaving negative trust would not have any affect on his rating.
See this user for example:
https://bitcointalk.org/index.php?action=trust;u=37522