There's nothing wrong if you don't care about your security and privacy because each time transaction was made, it's possible that your public key was revealed and could be publicly seen by anyone in the blockchain.  That time, the address that you've used can be tracked and traced and it could be your wallet address is vulnerable to hacking or it could be at risk.

It's the best practice to use different newly generated addresses per transaction and use the wallet that has this feature and AFAIK, Electrum wallet has this kind of feature.

I don't understand why only a public key that starts with 04 is shown, I think all can be seen publicly once it will broadcast in the blockchain.