What would happen if the blocksize were increased to 1 GB tomorrow? Pretty much nothing. Miners will always be able to create blocks less than the maximum blocksize.
What would happen if the blocksize were decreased to 1 KB tomorrow? Bitcoin would come grinding to a halt.
Too small blocksize = death to bitcoin.
Too big blocksize = non-issue.
I'd rather see the blocksize too big than too small.