You don't need to worry as long as you keep the private key of the address carefully, I have experienced similar problems and it is not a danger. The danger if you reveal your data, make sure to always store it securely, when today the problem of individuals being attacked, stealing information and appropriating property is also increasingly common in this space.