Price is not driven by people who hold BTC but by ones who are active on exchanges. Traders keep their assets on them and they do not care much about transaction fees. If they need to transfer value through different exchanges they just do it by quicker cryptos.