True, color blind people confuse color, simple remedy is to add some simple text next to or on the color.
Not sure this will help... If u looked at a red icon but saw it as a green one, would u read the text? I wouldn't.
I think that using symbols instead of text would be better though.