The password is purely for encryption purposes. If someone has an older wallet.dat and can guess the password they'll get the private keys. Sweep if you're not sure!