Another idea is to have a blade-like rack in which you put in compute units. It would be possible to buy the base box for ~5000$ with a few units and then add other cards as needed.

Of course, this makes cooling quite a bit more difficult, but it would lower the barrier to entry by quite a bit.