The difficulty increase slows as it grows, think of it this way, for the difficulty to double from the point it's at now, all the asics that are in the wild right now will need to double (plus more to cover the gpus and fpgas) that's a lot of asics.