It depends on how you manage them. The private key stored in your wallet is the only way to access transaction data stored in a Bitcoin address. If you lose them, you will lose your Bitcoins. Therefore, they are only safe when no one can access them, and they are not lost.
