I think that they are fearing that they will be hacked, because being hacked and your coins being stolen is not a great thing. You will lose your money and the hackers will keep on stealing.

Some people also fear that bitcoin would lose all of his value.