You still need a delay to see what size the miners picked, so your limit doesn't matter.
It matters because miners do not have a direct economic interest in forcing end users off the network. End users provide fees and demand for the currency which is how miners make money. There may be indirect interests though.