On contrary, firstly, Quantum computers exist already (military, aviation, NASA, etc) and nothing happened to us, although our governments could destroy this network for so many times. Secondly, I heard that Quantum computers will make mining much faster, though you won't be able to steal private keys with it.