It's actually because the block at the difficulty adjustment only looks at the difficulty of the block before it since we assume (for mainnet) that all blocks in an interval are all the same difficulty.
Huh, that's a neat example of unintended side effects.
Thanks all for clarifications.