Incrementing N will lead to immediate hashing speed decrease. Difficulty will reflect these speed changes (i.e. difficulty will decrease after N++) with lags. As soon as block reward depends on difficulty the reward will increase also and more miners will be motivated to join after N++.  It's not easy to predict now but we can be sure that some waves will happen on each N++ event.