Claymore have you looked at Epyslons improvements to SIA mining? It's on his github.
Also have you considered talking to SP_ about his DCR miner? He has a highly optimized DCR miner available for sale.
Not sure how interested you are in this sort of thing, but I assume if you're making money off a fee you want things to be as fast as possible.