Well if people stop mining, the difficulty goes down again, making it easier to mine. But I don't think people will stop mining, just that it will take some upfront investment in ASIC based mining gear to mine profitably. So it makes it a bit harder for the average user to just mine for a few coins...