Banning a subsect of people from the country counts as hate speech.
It is not a hate-speech. It is just a precautionary measure. Do the Americans allow North Koreans to travel to their country? No. Every now and then, the Americans deny visa to high ranking politicians from around the world. A few years ago, the current Indian prime minister (Narendra Modi) was denied a visa to visit the United States.