For bitcoin to really go up it needs normal people to regularly see things offered for sale in BTC, such as when they're shopping on Amazon or their local supermarket website, or even in the supermarket itself. It also needs to be as easy to buy things with as normal money, or at least as easy as paying with a debit card. Bitcoin conferences may be a good thing but the existence of bitcoins isn't news to those who attend them, even now if you stop people in the street and ask what they know of bitcoins most will say they've never heard of them. If the average Joe had £20 worth of bitcoins that'd be a huge increase in the amount of fiat invested in BTC.
I think you've got it the wrong way round. For the average Joe to have $20 worth of bitcoins and for it to be accepted in all the places you're saying the price will have had to have increased enormously. You've probably seen similar calcs before but give you an idea, given 21m bitcoins divided by pop. usa would mean 66.3 mBTC p/p (assuming all mined, none lost, all non-USA citizens sold). For 66.3 mBTC to be worth $20 1 BTC would be worth $3,316.
This assumes your 'average Joe' holds an average amount. However, given many worldwide are also interested, given there'll likely be fewer than 3/4th, given that many of those are either put away for posterity or lost and given that a small number are likely to hold a huge quantity, for the 'average Joe' to carry about $20 worth a single bitcoin is likely to be much much higher.
There are many many steps between where we are today and the scenario you describe. I don't see the benefit of looking at bitcoin as unsatisfactory today simply because those steps have not been taken yet. More important is that the steps taken so far are leading to the next steps and it is here I believe we have significant momentum.