We have free speech too, it's simply part of our human rights. But we also have another very important rule: Your human rights end there, where you intersect the human rights of somebody else. Which to me is a really reasonable limitation.
Try giving the nazi salute or giving someone the middle finger in Germany and see how far that gets you.