There are people who don't want to deal with it because it is something they don't understand. There are also people afraid of regulatory problems.
None of these are good reasons for people to be afraid of Bitcoin, since understanding its use is quite simple, and in most countries in the world Bitcoin is not illegal.