The difficulty readjustment should be done not only for this reason but to protect the coin from a 51% attack, as was discussed here a few weeks ago. As long as the block reward is untouched, I'm sure the entire community would support such a change!
I agree 100% with you. I just wanted to give one more reason for a dif. retarget change. This change will also have a positive impact on a nw hashrates and of course on a market cap and coin value. It is a positive chain reaction.