The OP gives a valid technical argument for raising block size limit, but is neglecting a financial argument against it.

The miners' income has to be greater than the cost of their work. Miners' income is inflation now, but is expected to be replaced by fees,
since inflation halves every four years. Purchasing power of new coins might be sustained for a while but must converge to zero in the limit.

Transaction fees exist only because there is a competition for block space. Eliminating that competition eliminates the fees and with that mining.

Therefore block space has to become and remain a scarce asset.