I don't quite understand why these need to be removed. I think having those and the trust system would work fine together, the trust system can be used like normal but, the scammer tags are issued when it has been confirmed that the person scammed. What we are effectively doing is removing a layer of protection.
Obviously, you justified giving them the tag in the first place so I don't know why you would want to remove it now. Any reasons? Or would you just prefer to use the trust system which isn't moderate unlike the scammer tags.