The block size is the same regardless of difficulty. More miners mean higher difficulty thus harder to find a block. There will be another block halving on the other hand soon. We are also changing the difficulty adjustment algorithm with the next Core Release in order to mitigate the "greedy miner" effect