You are never going to get human consensus on an unlimited block size to the point where it isn't controversial. Just isn't going to happen.
The good news is that Bitcoin is not software. It is a protocol
. Of course you have to get people to agree to use your fork but that is another thing entirely. Errr, consensus?