price volatility, complexity, PR, worldwide bans, strangers around, relation to black market/drugs, exchange bankruptcies, long waiting time for first 3 confirmations, missing support and mainly, they don't won't to be responsible for their own money. yes, it is so simple..
He said it all.
About the long time confirmation I dont like users react to this. Is it because they think it will not come? There should be this thinking that many are doing transactions that is why it takes so long and the ledger is getting bigger.