yes that is very right. the number of bitcoin users are increasing too much and that is the reason that the supply will decrease and so the price of bitcoin will increase as no one is welling to sell their bitcoin.
Only the block halving makes sure that the supply reduces every 4 years, and not the increased number of people finding their way into the Bitcoin world. Less supply means less pressure on the market/price. Block halvings are meant to prevent long periods where there is more supply than actual demand, that eventually will result in a lower price.
That is the good side of bitcoin halving which it lessen the supply of the bitcoin but in the other hand it increases the mining difficulty and also halves the block reward for the miners which it makes it harder for them to earn decent profit and can be a reason why other average miners abandon mining or supporting bitcoin because of low profit.
Block halvings could indeed turn out to be an unwelcome happening for pools, but that's only when the price doesn't go up after that to compensate for the halved rewards. If you look at the block halving last year where at that time the price was sitting well under $700 and compare that with current price, then it's obvious that miners won't suffer any losses as result of the halving as the price nicely compensated the halved rewards
This is a view of an outsider
But I suspect that miners themselves are going to disagree with you, at least, that part of them which are exclusively into profits with Bitcoin (which should be pretty close to 100% nowadays, though). They are obviously looking at fees not from the absolute angle, i.e. how the fee profits stand now against then (that's what we, non-miners, think), but they rather think in relative terms, i.e. how much they actually earn versus how much they could potentially earn given the current setup. And from this angle they may well think that they don't earn enough, i.e. don't squeeze everything what is possible to squeeze presently