Speculation would cause reaction to many investors depending on what the speculation is, but that's not the primary factor in affecting the price.
Once the investor reacts, it is either selling or buying.
That's why when there are many reactions to a lower price, investors tend to take chance of buying those dumped coins.
Increasing demand while shortening the supply. That's what affects the price.