We give our personal data to banks, financial institutions, department stores such as Walmart, Amazon etc, government institutions and so oneverytime.
Those websites openly sell and share our data with their partners , and nobody cares.
Some of us care. Some of us care enough to not give our personal information to any of these sites.
Still, the issue here is people worrying about become a target for a physical attack. It's very hard to hold someone at gunpoint and make them empty all their fiat accounts in to yours - there will be withdrawal limits, extra security checks, phone calls to and from the bank, delays, etc., not to mention the attacker must use a bank account not linked to them but they can still access so they aren't immediately identified. Conversely, you can hold someone at gunpoint and make them empty all their bitcoin wallets in to yours in 5 minutes, completely anonymously, without any additional security checks.
I don't want the whole world knowing my name and address, and I certainly don't want the whole world knowing my name and address and the fact that I've bought hardware wallets.