I think your average joe does not really care about whether it is anonymous or not. The biggest impediment to widespread adoption is that it requires too much of a learning curve. Once sending crypto becomes as easy as sending a tweet then you will see the mass audience and not just the technologically savvy adopt it.