I noticed the pool starts off with difficulty of 1024 and then after a while mine drops down to one and then climbs up before stopping at 4. Realistically does the miner need to be able to have accepted shares at the 1024 difficulty before having any remote chance of solving a block.
No, your diff could be set to 39.5 Billion and you would have the same chance of finding/solving the block.