Questions for those who want to raise the block size limit:

Does increasing the block size lead to more centralization?
Does increased centralization lead to a less secure network?
Does a less secure network undermine the value of each bitcoin?

If the answer to all 3 questions is 'yes', then it appears that by increasing the block size limit we'll have made it easier to transact something of lesser value. What is the point?

First and foremost, bitcoins must be a monetary foundation and that can only happen if bitcoins themselves have value. Any changes that potentially lead to that value being threatened (eg. centralization) will lead to the failure of Bitcoin.

Centralization of the payment network (off chain solutions) can be kept honest through competition/free market forces, centralization of the underlying money however cannot.