If we didn't pay taxes then how do you think society would be? We would have to go back to being hunter and gatherers. Infrastructure would not be there.
I agree to what you say. I would also add that the government needs taxes because it has to fund its budget and without the masses paying taxes, government is nothing but a naught.
Also the taxes we give tend to reduce the gap between the rich and poor and this gap if finished, finishes many crimes from the society. The income collected as a result of taxes is redistributed by the government among people in the form of facilities.