It's the other way round.

Holders are ok with small blocks because of the "anti-censorship" that comes with
the ability to run a full node with limited resources, which is made possible by
the smaller amount of transactions in smaller blocks.

Users - i.e. people who would like to actually buy things with bitcoin - would benefit
from bigger blocks, smaller transaction fees and faster processing of orders.