I googled the error and found post #4625 explains what's going on.
https://bitcointalk.org/index.php?topic=638915.msg22374228#msg22374228It has to do with not having enough virtual memory.
-dmem 0 prevents it from using double your memory and fixes the issue or you can adjust your virtual memory accordingly.
Seems like monero is much more memory intensive than ether mining. Lots of errors showing up now on my machines.
But anyone know why Claymore miner manager won't work when you're running Monero? I tried google... but no luck!
Yeah, this is correct for xmr-stak, cast-xmr, sgminer, and probably every other cryptonight miner. Take your memory on all your video cards, add it up, and you need at least that much virtual memory. Yeah, it sucks, because you can't use a very small SSD.