There is no double standard.

White racists are judged by their ideology. Not by the color of their skin.

White racists like to think that "white people" and "white racists" are the same thing. But they are not. One group is distinct and separate from the other.