One of the worst problems is volatility... this is what makes people look at bitcoin as an investment, a way to get return... this is why all of us hold bitcoin instead of spending it like a normal currency...
Other issue is the block size and network capacity to handle serious escalation...
I hope that, as time runs, evolution and adoption will take care of these issues