Most of the coins are free from restrictions but the users themselves give up their anonymity while trading the coin in or out from fiat currency. This is the point where the government can really track users. If we are able to create a self sustaining market around privacy focused coins, there's no stopping it. Though real estates and large physical goods won't remain out of government radar.