If people in my "country" can loot a minority by will of its numbers, why can't I get together a bunch of guys in my town and rob some neighbors? After all, they consent to being robbed if they don't leave.
That's why your arbitrary standard of concent is a load of horseshit.
That's why pure democracy doesn't exist anywhere.
Humans are fallable, that's why we have laws and basic legal documents like constitutions that secure some basic rights and principles to protect the minority from the majority. Beyond that, it's all compromise, which really can only be done through a majority vote.