I don't think it's all that hard to setup the physical bitcoin-only store. Your main problem would be to gather those customers who have the bitcoin to physically go in and buy at your store... Which is why it's probably better to have online sites start taking bitcoin and making it a more popular payment method first, then once it's more widely used start looking into physical shops.

Just my 2 satoshis.