Moving the coin daemon to other machine and/or running several in "balance" mode seems to improve the speed, although it still does not come close to BTC mining rates.
I assume at these speeds there is lots of talking between miner and coin daemon going on and even slight delays in http responses from daemon accumulates and results in lost hashing power.