For me it is transaction times, and the inconsistency thereof.  Sometimes confirmations are quick, other times they are not.  I would like them to be predictable based on what your transaction fee is.  I think that this randomness is a barrier to wider spread adoption.