yes you have to download the whole blockchain, but you may speed up this process, by looking for a torrent and then bootstraping it into your wallet.
Here is the help on that: https://bitcointalk.org/index.php?topic=145386.0, for the up-to-date torrent use google.