That's as long as the transaction doesn't concern any real life goods. Try buying a house or a car and you'll see how fast the authorities come knocking on your door.
Bitcoin isn't anonymous! It's one of the most common wrong assumptions that people have.
You can be anonymous if you mine the coins and trade them for altcoins or cash. If you bought the coins from someone on an exchange the anonymity is no longer there.