If you want to mine for fun, you could buy something like an antminer S3.
This is exactly what I'm doing. I looked into the GPU situation and quickly decided ASIC was the way to go. I found S3+ units going for $20-40 right now, so I picked up a couple to have some fun with. All academic, but definitely fun!