You definitely cannot do anything in which users have administrative power over others. The red-trusted scammers would have a field day just using the system against the people who had sent them the feedback.
Pretty much this. Under this system most of the default trust network would be banned within the hour as all the scammers and spammers they had red-tagged retaliated against them.