If you only need the client once in a while you could run a node on your pc to keep up with the blockchain. Then when you actually need to make a transaction you could copy the blockchain to another machine (e.g. a notebook you only boot for bitcoin) and manage your wallet that way.

Remember: You don't need the client to receive BTC and you don't need it either to check for your balance. You could bookmark your addresses on blockexplorer in your browser for example.