yes, that's right . Your private key is a your home key so if you lose your home key , the thief will enter your house and take your money away.
You should check your site carefully before put your private key in . Losing your private key losing your money .