Why would the number of miners decrease? I guess when equilibrium is reached difficulty would be at least what is now - therefore at least as many miners as there are now.