its true that it is possible if a bunch of whales get together and decide to sell that they drop the price however in this case everyone would receive dividends and once the price is down, it would give other big players another chance to get back in which results in more dividedns and a price increase.

The only way you lose is if you sell at a loss, but thats the case with any cryptocurrency