Yes, and cash has levels of anonymity too, depending on what type of cash is used and how it is used.  Most bills are serialized in an easy to scan way, and increasingly transactions are through machines or banks, so there are some very non-anonymous check points.  Paper cash is imperfectly fungible with regard to identity and transactions.
If you pull bills out of an ATM and give them to someone scurrilous and they are next deposited into a bank, you may become an interested party by law enforcement based on that chain.

For more anonymity they would use gold coins as cash.  Those are all the same. 
The Swiss argument against Bitcoin might be more easily pointed at gold than at bitcoin.