Remember that there is OpenCL supporting gpus already avalibe for ARM cpus...
ARM Gpus from 2012 onward are going to Support full OpenCL, Directx 11, OpenGL 4.0, OpenGL ES 2.0 and some even Directx 9.
Last I checked there was no API yet though, at least not for Android.