Although that is true. The difficulty would also increase to prevent any issues with quantum computing. The real issue with quantum computers is breaking the current algorithm and not the mining aspect.

A problem with the mining aspect is that quantum computers could push up the difficulty and render the network difficult for those who can't afford quantum computers.