In addition to the info that these guys have given you, it can actually be even easier.  Depending on where you host your site, whether it be VPS or just straight hosting, there are installer scripts built into the server most of the time.  This is very true of rented hosting.