If it becomes clear that the allegations are true, then this should disqualify Kavanaugh simply because that would mean that he's currently blatantly lying about it. All of the other arguments regarding the particulars of the case are irrelevant in the face of that fact, assuming he's guilty.
If the government was full of a bunch of honest philosophers who really cared about doing things the right way, then IMO there's enough evidence to halt the process and look into it carefully. But we all know that both sides are acting 100% in bad faith at all times, and are only looking to win as much as they can. With that reality in mind, and even though I don't like Kavanaugh, I feel that if the Republicans back down now in any way, it'd set a bad precedent for completely derailing things based on fairly weak accusations, since a complete derailment is a possible result of any delay.
The best-case scenario IMO is that we quickly get solid evidence that Kavanaugh is guilty, and then he's replaced by someone better who is then confirmed before the Democrats have any possibility of taking back the Senate. The worst-case scenario is that this drags on for a long time, the Democrats end up getting a more anti-constitution justice, Kavanaugh is proven innocent after the fact, and a strong precedent is set for winning by throwing weak allegations around.