Certainly they can, but as long as they keep collecting the money through taxes it is an immoral use of force.
Saying that collecting taxes is immoral doesn't really advance your cause much. Most people think its immoral to allow the poor to starve and thus collecting taxes is the lesser of two evils. What you need to do is either make a moral case for allowing the poor to starve or stop complaining about taxation being immoral.