There is no way of telling whether people perceive colors the same way you do.
On a related note, you'd be interested in the
Asch Conformity Experiment. It showed that people adjust their perception to fall in line with what others say.
Didn't VSauce do a video about this a long time ago? I remember it being interesting and he seemed to suggest that there was a way of proving this...