Will someone have access to your wallet without your device but the person manage to see your private keys and copy them without your knowledge. Will the person be able to withdraw your money or change password and block you from having access to your wallet?
Adding a password to your wallet doesn’t really do much except protect that device, your seed phrase can be imported into another wallet and your password won’t be required. Like Charles-Tim said, if a person manages to get hold of your private keys, he can access your wallet and spend your coins. It’s the reason why bitcoiners have the saying “Not your keys, Not your coins”, so store your private keys offline and keep them safe.