After talking to many people, it seems the biggest factor that scares people is the volatility. You don't know how and when it will drop or rise, and a lot of people are not comfortable with taking risks. High risks = high rewards, but risks can break you down very badly. That's why noone should invest if they can't afford to lose it