Start small, as in 1 or 2 GPUs. It's easy to add more later. It helps to have the machine be multi purpose so paying back the entire cost would merely be a bonus.