I don't think that the QC mining will increase the difficulty and let the blocks stay the same size. Because QC for now are reaaaaaaally rare and that's means that only few can afford to use them and few + bitcoin node are already a problem, so I don't think it will be accepted the worsening of the situation.