You should keep your private key secure. For example, Myetherwallet offers to print private key during the registration. You can try to keep your key on paper.