If you're going to be your own bitcoin "bank", you would want to have the blockchain downloaded, along with bitcoind possibly with your own code for wallet management, talking to bitcoind, etc.
Here is a couple of links that may be of some assistance:
There may be third party services and applications you could use with SPV or connecting to another node, but I would probably suggest having the blockchain downloaded instead.