The problem is the average person on the street in India is very poor and they constitute almost 80% of the population. So the amount of money they will have to spend on bitcoins, might be relatively low, compared with other Western countries.

Yes, the numbers are large, with India having 1,324 billion people in 2016, but if they only have $1 worth of fiat to buy bitcoins, then that would hardly have a impact on the price.