It does take some time.
It took me about 20 hours running Bitcoin-Qt 0.8.0 on OS X. My bandwidth usage was pretty moderate though at only a couple hundred Kbps maximum and even then only at times. Seems this is one of the more moderate cases compared to deepskydiver and others I've heard from who've gone through the process.