Will someone have access to your wallet without your device but the person manage to see your private keys and copy them without your knowledge. Will the person be able to withdraw your money or change password and block you from having access to your wallet?
Anyone could get some clues or derivatives to either find a means to spend your coin or convey them to wherever he wants.....that can only be achieved when he's in touch with your seed phrase.
Anyways, except otherwise, the person must be a close associate of the scammed In question. Maybe not too close, but saying out secrets like "how much worth of coin you have" usually raises an eyebrow of anyone. It's advisable to not even store them on chrome default tabs/ remind my seed phrase etc.
Sandra 🧑🦰