No one will know what you're doing if you connect to your electrum server through port 50002. Information won't be transparent, both your main & remote pc will communicate using encryption. Unless I missed something, it doesn't make sense to me. You'd use Tor if the server wasn't yours and you wanted to protect your privacy.
Actually everyone who can listen to the traffic inbetween (including the ISP) knows that you are communicating with the server. They just don't know
what is being communicated.
TLS does not protect against metadata analysis in terms of knowing
when does who communicate. It just protects the content.
If the Electrum server is actually connected to the bitcoin network (which it has to be to retrieve up-to-date information), then it is straight forward to deem that server and anyone connecting to it as a
bitcoin user.
TLS does not protect against that since it does not hide your identity.
The main question here indeed is whether OP cares that other entities might know he
has something to do with bitcoin. If the answer is yes -> Tor is required. If the answer is no -> TLS is definitely good enough.