The block size is an intentionally limited economic resource, just like the 21,000,000-bitcoin limit.
Changing that vastly degrades the economics surrounding bitcoin, creating many negative incentives.
One of the most lucid comments I have read so far. Thank you jgarzik