Absolutely. That's the importance of our private keys, that we need to store and keep it to ourselves or in any places that we think it is secured enough. We should be the only one person responsible to our digital wallets and the control over the coins/assets that we stored inside it. If it isn't ours, then probably it belongs to anybody else