Set each worker's difficulty separately: do not add them together and then divide by 1.4.  In any case, you should not need to do this unless there is something wrong with your miner since you difficulty will auto-increase to what is appropriate for your miner.