You are indeed allowed to move to pay less taxes (tax evasion is staying but moving your money illegally), unless a US citizen that is.
Do US expats who live and work in another country have to pay double taxes? Once to the IRS and once to the tax agency of the country they reside in?