Segwit == block size > 1 MB.
The faulty understanding is that Segwit != bigger blocks. Just because it handles data differently, that doesn't mean that the block aren't bigger.
segwit only = bigger block ONLY IF:
1. users move funds to segwit keys
2. segwit keys get accepted into blocks
3. native spammers dont fill the base block with native spam