What makes the impact is not the number of people who want to trade but the money that they want to invest.

Imagine an institutional investor wanting to sell 1,000 Bitcoins and a million users trading in less than 100 Bitcoins, the influence of one person being stronger than a million.
Talking about price and the change that occurs in it is always for those looking for a quick profit and not for those who invest in the long term.