It is actually possible, just not easy as of bitcoind 0.9.

The keyword you're looking for is watch-only address/wallet, and you can achieve it today with a fair amount of work that involves multipe RPC calls to bitcoind.

The good news is that bitcoind 0.10 will support watch-only addresses out-of-the-box.