The fee is due based on the transaction size, so if you need to transfer 5 BTC from small payouts 0.01 each you need to include 500 inputs in that transaction, which will very likely take more space = bigger fee

Also if you get a payout of 1 BTC, you can spend it (without fee) immediately on the next day, but if your payout is 0.1 BTC you will need to include a fee if you want to spend it before 10 days and for 0.01 it goes to 100 days