The government.
I don't believe that governments are doing anything at the moment to stop people using bitcoins. Even the most strict governments as China and Russia still haven't done anything major that would cripple this technology.
Yes, everybody has issued warnings, etc, but this is nothing compared to what they can really do if they want to, the governments.