Yes, as explained above, electrum sends the request to update the balance of all the address in a wallet, this is what sync does, so server does knows all the addresses of a wallet. And maybe some of the servers do keep logs, there's no way to know for sure whether they do or not, I think this might be the reason why during a privacy rating review recently, electrum had a very low rating as far as privacy is concerned.