0) Damn Small Linux is 50MB in size, install it somewhere and install bitcoin on it.
1) Encrypt the disk/file.
2) Use a Cloud-based service like JungleDisk.com to backup your wallet/distro. It costs $5/month & the first 5GB is free.