Some people remember in their heads a long pass phrase which is the seed for their wallet. From that seed all their private/public keys can be generated. In this way the private keys are stored nowhere in the network, nor on your local machine. The needed private keys are generated from the seed each time you need them.