Not just privacy and fungibility issues, security too.

White-listed addresses are innately insecure. Re-using addresses makes them more vulnerable to theft.

If you run a full mining node, blacklist the whitelist. Work out how to prevent all "white" addresses from ever getting their transactions processed.