I've been searching a bit, there is no way to set a minimum worker difficulty?
Not on the website. However, I think the server honors difficulty requests sent by stratum as a command-line option of your miner.
Through my research I read that the server actually rejects the command line setting on bfgminer
Really curious if it can or can't be done, can anyone provide answer?
It can not. There is pretty much zero reason to set a custom difficulty. The server already pretty aggressively chooses an appropriate difficulty.
Wouldn't having large asics doing higher difficulty ease the load on the server?
I understand a machine can do 1024 difficulty fast, so running 256 will just submit more shares at a more aggressive rate correct?
I was under the impression it was the opposite, that if 1024 was set and the machine could run through it it would end up submitting more shares at a higher rate than 256 from the constant new work and submitting more shares of less difficulty.
(Sorry I am a little bit confused at this point!)