The problem is that small miners are the ones who make BC run in the long term. If they all leave the business, the protocol will take an hit in performance and stability.
Markets move pretty fast in either direction but business creation is harder, takes more time.
Without them, we are left with gamblers and speculators maintaining the network. NOT GOOD!