The holders of Bitcoin are the only one who understands and believes in the future of cryptocurrency. So those who have been selling off their coins are the ones who just want a quick profit but don't have any idea what is going on. Bitcoin is falling but the economy for adopting blockchain technology is already getting big.
In my own opinion, you are right that not everyone do really understand how the cryptocurrency works or when it will go in the future but as the technology grows and the demand in the market increasing, they should hold their coins because bitcoins price will be so much bigger in the future.