Proper and widespread adoption is really the only thing. There still isn't a great deal of that. Also, most 'real' buying especially for first timers does not take place on exchanges. They'll go to a buying service like Coinbase or Localbitcoins. This leaves the long term residents of the exchanges firmly in control of the price.