His 1st priority should be refuting this accusation and maybe in his way that is what he is trying to do, but IMO he is showing a lack of urgency.
Just doesn't show me that he is serious about his rep.
The fact he has not shown a willingness to challenge the allegations in a proper manner does not help his case. He has refuted the allegation but did not provide anything of substance to cast doubt over the allegations. Overall, it does not look good on his part when (as you said) he is showing a lack of urgency.
If he does have a viable explanation I have no issue removing the tag, but again the lack of urgency and the seriousness of the accusation makes me feel the tag necessary for now.
He really should have addressed the issue with a full defence by now. He has not presented a case for any tags to be reconsidered and that is a failure on his part.