The HK agreement between miners and blockstream (basically Core) represents consensus. It clearly says both 2 MB hardfork and Segwit to be delivered. Doing one but not the other one is actually stalling - not to mention breaking intentionally agreement is quick way to loose all credibility - not best day for Bitcoin if it really happens considering blockstream basically represents Core, the most used Bitcoin full node implementation today.