I would suggest you to use Electrum as a wallet , because It gives you a 12 words seed when you setup the wallet for the first time , and you can recover your Bitcoins & wallet with those words in a case of a computer failure or device get burnt as you said etc ...
Yes Electrum! You can have !the same! wallet on different computers, on different operating systems.
And linux distribution for anonymous web surfing Tails have pre-installed Electrum wallet...
"New features: Electrum is an easy-to-use Bitcoin wallet, you can use the Bitcoin client persistence feature to store your Electrum configuration and wallet; the Tor Browser has additional operating system and data security"
http://distrowatch.com/?newsid=08824Edit:
Ups, sorry I see tails was already mentioned...