You can't - humans always gang up and appoint leaders. There never had been nor will there every be a society without a publicly enforced government or violently enforced political authority.
If that is your reason not to support freedom, then I can only conclude you must support murder. After all, there never had been nor will there ever be a society without murders.