I believe it's mostly people who are hearing things from the media who are preferring not to use bitcoin because of the negative news
The media have a negative impact on bitcoin's PR. Most of the time it's about bitcoin associated with drugs deals and criminals.
That's bad, there is more to bitcoin then that.