If you want to mine sha256 based coins, a used S3 might be a cheap start, but as others have said ROI is hard to get these days.
You could get a Compac USB stick or two and solo mine for fun.
With S3, there is not ROI at all. The cost of electricity will be higher than the bitcoin produced if you pay for electricity.