Presumably GPU VPS's are the same to use as a CPU VPS e.g. the same Ubuntu OS. It's just that the hardware specs "behind the scenes" are different. Yes?
It might be more difficult to get it to work with the correct drivers (that's how it was on my PC). I have no idea if it works out of the box on a VPS.