You cannot simply hope to maintain or preserve 'true' anonymity with a publicly accessible ledger, forever.
it is not about the ledger itself being public, it is instead about what is being written in the ledger and what cryptography algorithms are being used in constructing it. in bitcoin, what you said is true but in a privacy oriented cryptocurrency like monero for example that also has a "public ledger" it is less true.