On ethermine pool I can tell you that it has always under reported my estimated payment and hashrate, but the _actual_ payment matched almost exactly what I expected. It may be that something is off on their side ... but as long as it's off in the same way for all miners then your test is relevant (for which miner's best).
If you want to compare payouts, then leave it longer than 24h (say, 3 days?) and after you stop the rigs, allow for at least 1h more so that the last shares you mined get counted in the last 1h window on Flypool.
I secretly hope bminer is better in the end, simply because dstm on my rigs is reducing hashrate due to too much cpu hogging.
Unfortunately, my connection to flypool goes down and all four rigs stop working at the same time around 13:30. Here is the summary of tests I have for the 12 hours, you can check on the page:
dstm:
https://zcash.flypool.org/miners/t1SstC4pJy3JtKdqSoFJZk6SUtyznfo1ZB6https://i.imgur.com/g7agrmg.pngbminer :
https://zcash.flypool.org/miners/t1LLJPAoYajZjPQggPZcdDpwPont4AoGvfqhttps://i.imgur.com/sjcIHk9.png Pool avg. hashrate Payout
dstm 5.29kH 0.03619ZEC
bminer 5.48kH 0.03847ZEC
If you are interested in seeing the full running logs, here it is:
https://ufile.io/f2906Note that my experiments should NOT be interpreted as a general experiment that can apply to all situations. The best way to find out which miners work best for you is to try it yourself.
To be honest, I see this as a healthy situation for all of us. As long as the difference between bminer and dstm is small, they will have to play fairly (for example, not raising devfees) and we get more choices.
If I have time, I may run a comparison again maybe on another pool. But I cannot promise because doing this takes a lot of energy.
