The problem is that when people mine really hard really fast briefly and then leave it, the difficult is raised significantly to account for that miner.  Once that miner leaves and the difficulty has been adjusted to account for their presence, it can take days to get the blockchain moving again at a steady pace because the remaining hashing power isn't enough to hash enough blocks over a short period of time to alter the difficulty to reflect the lack of the really powerful miner.