Here is a relevant article on the Bitcoin wiki about clients that don't download the entire blockchain (i.e. thin clients).

https://en.bitcoin.it/wiki/Thin_Client_Security

There are added security risks because there is no way for a thin client to verify a transaction independently of contacting other nodes or servers. This makes thin clients susceptible to a greater variety of attacks, especially on untrusted networks.