Yes, the exchange and the tax authority can connect all the transfers that come into contact with that address, so they can also know your wallet balance if you have deposited all your funds into a single address.

And which wallet is irrelevant here, it's just the wallet software that we use in different modes but eventually all of them do the same and one who have the keys will have access to the address and all others can just watch it.