The default Windows cgminer builds appear to require OpenCL.dll installed on the system.
There is a cgminer-nogpu.exe in the windows binary zip file

Don't know how I missed that one. Could have saved me a lot of time :-) Thanks. I was stuck in the newbie area, so I couldn't post here earlier.