A UPS is generally going to provide the most reliable power, but you're going to need a pretty substantial one for each system, and don't expect it to give you more than a minute or two of run time at full load.  If you expand beyond 2 GPU/machine, you'll need to look at datacenter-grade UPS systems.