I think the important thing is that the individual difficulty will increase as long as the number of new coins is a constant. The more people who mine, the more people the coins will have to be divided between. It's like winning the lottery, except more and more people will pick the winning numbers. In the end, no one is going to bother entering since the ticket price will be that much higher compared to the prize you get *if* you happen to win that day.