ICOs are like IPOs, but for new cryptocurrencies.

Anyone can develop a new coin, so anyone can do an ICO.
To join an ICO, you just have to invest in it. Usually investments are made in Bitcoin, but sometimes you can even pay with dollars or other fiat currencies.