Also, RBF was certainly not consensus... maybe consensus of the devs but... most people's comments I read are quite against it.
RBF is "optional" so it doesn't affect anyone that doesn't want to use it (it is not the slightest bit controversial really).
It's opt-in by default, and so for the regular user of bitcoin who may not be up to snuff on all the technical stuff, that means it's on.
Let's be honest, though - it certainly is controversial.
con·tro·ver·sial
ˌkäntrəˈvərSHəl,ˌkäntrəˈvərsēəl/
adjective
adjective: controversial
giving rise or likely to give rise to public disagreement.
People disagree on RBF, thus it is controversial.