Moderators can't interfere on this, it's out of their job description, trust are not moderated, so only those who give you a negative trust can remove it.
If those who trusted them does not think the red trust is valid, then just hope they'll be ~ so people will not see that red trust visible.