OK, so I assume that the password is the one of your worker, not the one of your userID getting into the pool right?
Correct. The password for your pool user, is unrelated to the password for your workers (unless you specified it to be the same, which I strongly recommend you do not).