If you are so sure about this, why don't you set up a Secret Question and try yourself?

Spoiler: NO. No one can access your account with just the secret answer. This will only lock your account - as explained in the previous page. Please read the whole thread before making a new post.