its like your password for email.
if someone know the password of your email, he can acces your email, so if someone know your private key, someone can acces to your bitcoin address too