what do you mean by not using, either they are holding or not taking interest it and therefore not even trading it, if you mean that they are holding it then the price of bitcoin will go up but if you mean that people are not taking interest then the price will certainly fell down.
I think this is a series of event. When people are holding it and not dare to spend or sell it the price of bitcoin will increase. Demand is more than the supply. But since bitcoin is not a necessity, if prolonged no movement, people might forget that bitcoin exist and move on with their life forgetting about bitcoin. If this happen bitcoin buy wall will be gone and bitcoin price will decline.