Keeping your private key in secured and safe place is necessary.However, don't be too scared in your storage that someone may steal it.If you will just keep your private key in your phone with password then it is safe.