Yes. We had an imposed 250KB limit for ages that was raised to 1MB with a soft fork, the same can happen with a 20MB or more limit with a 1MB imposed limit.
There's 3 priorities, enough from fees to secure the network, an efficient and uncongested network and incentive for the network to grow. Imho that needs dynamic limits but the limits have to be reached to see how that would work in the real world.
There was no soft-fork for the 250kB default block-size limit.
Currently the fees are very, very, very far from being anywhere near of an amount sufficient to secure the network.
We're all having a free lunch right now, due to coins still being minted, but if that was to stop tomorrow, the network would be in an extremely shitty state.
What's the problem with paying 10 bucks instead of 10 cents to securely transfer a million dollars?