Have you heard of render farms ? I think they can offer their "services" for custom cuda software - and often have thousands of GPUs and much cheaper than standard cloud gpu instances.

One of the many theories