The private key represents your proof of ownership, the coins will never be directly on your wallet, they will always be on the blockchain but you have control over them with your private key. If someone steals the private key then they can steal your BTC.