The language/locale is set in System Preferences, Language & Text. The language chosen in the Language tab determines the translation used, and the setting in the Region tab determines things like dot/period for number formatting. (That's for 10.8, in 10.9 the section looks a bit different.)