Whatever is public could be visible to anyone, which means usually your public key/address and transaction details of that address will be visible to anyone. So unless you tag the address, no one can see the address from where or which wallet. Like Exchange, you can tag the address as well, but I don't know how to do it. For example, you may see Binance hot wallet, which means it has been tagged by Binance. So you shouldn't worry about your privacy; it's protected unless someone knows what kind of wallet or address you have been using.