On Windows CUDA is included with the drivers... I don't have the CUDA toolkit installed and I can use rpcminer-cuda with no problems. Under Linux, the CUDA toolkit is indeed required.