You probably don't have enough virtual memory, be sure you have at least as much as your GPU memory (example if you have 6x gpu that have 8gb of ram, set virtual memory to ~50gb) neoscrypt algo need it.