But I thought the whole point of doing a live ubuntu boot was that you have a fresh OS free from all the nasty stuff?
Yes, that's true. The other benefit is that nothing is persistent, so whenever you are done, just remove the CD or USB drive that holds the live image and you are good, but the bigger advantage of using a live image is hiding your tracks. Think Tails OS.