I'm running out of ideas on how to help you understand this fundamental difference. If people hate you enough to not want to interact with you, you have no right to force yourself on them. That's just how society works; you play by the rules or you get shut out.
I have already explained everything in one of my earlier posts. Also, you said it yourself that if my beliefs clash with other people's, either they or I must adjust, so there is still no room for voluntary change if that was your point. When you have to adjust to something against your will, this is coercion under any name...