I'm not talking about removing feedbacks left by inactive members, most of it remain to be legit and valid. But there is some cases feedbacks become wrong. Let's say user receive negative trust for not returning loan. And after some time user who left him feedback dies or simply become inactive. User repays loan, but he still can't get rid of red trust. Offcourse, it would be wrong to remove all feedbacks left by inactive member or remove him from DT because all other his feebacks remains legit. For now such issue doesn't happens often, but eventually it will become more frequent.
Sometimes DT members leave negative feedbacks when they have personal war against certain member or giving relatiory feedback, but that's not one of these cases. It's not that OP didn't deserved all feedbacks he got.
Some another DT member can leave a review with explanation of a new condition. Negative tags not a number only. When someone wants to learn about someone else he reads all feedback and then can make conclusions basing on that. We know several stories when forum users have some negative tags but it doesn't really matter, they don't have big problems with that because it's or irrelevant from the start or become irrelevant.
Each case should be considered by itself. If there is some really big problem, I think we can ask admin for help. But in mostly all cases there's no need in that.