You are always advised not to share your seed phrase with anyone for security purposes but since you have already discovered that someone has it meaning that the person can have access to your funds regardless of the amount, abandon the wallet, get a new one and make sure you don't expose it again. You can also help yourself by getting a stronger password and something very long that can't easily be memorized by anyone.