Actually, the limit specifically prevents any disagreement over what constitutes a valid block in regards to size. Without that limit, the entire network must trust all miners to never disagree on the size of blocks they are willing to validate and relay.
You dont need trust
all minners use the same maximum block size they are willing to validate and relay, because there will be always only one longest chain called Bitcoin, thats the beauty of PoW and selfish interest of miners to build only on top of longest chain, otherwise their just building worthless chain and miners will quickly learn the hard way to dont build worthless chains for whatever reason, like limiting only to 1 MB.
You should not be afraid some miners might temporary build on top of smaller chains because of their software having disagreement over what constitutes a valid block in regards to size, because they will learn the hard way by producing worthless blocks, thus they are encouraged to build on top of longest chain only next time (after they realize their mistake).
I realize i am in the minority and my opinion is not appreciated, and will never be accepted by this crowd...
I dont think your minority, people tend to post when they disagree, at least I do.