Not sure what you are getting at. Are you saying you think the number of blocks on any given day has no impact on the difficulty?
The block interval follows a Poisson distribution. That's why on rare occasion, no blocks will be found at all for a couple hours. The distribution evens out over time, tending back towards the 10-minute target interval.
A single 24-hour period can follow the same dynamic, with the distribution being smoothed out over the 2016-block difficulty adjustment period. Focusing too much on the short term can lead to some pretty drastic miscalculations.