If your private keys gets exposed, you don't change it. You generate a new set of keys. This time, make sure you know well and well how to secure your funds.

Also, if you have significant amounts of coins, I heavily suggest that you get yourself a hardware wallet.