That has zero effect on your reward.

If there are fewer blocks, your reward per block will be higher - for the obvious reason.

Variance is the only relevant point.
As long as the pool is mining enough blocks every diff change then the variance averages out - you get more some months and less other months.
Overall you're paying slush more than twice the fees you pay here - so expected less average reward at slush.