Every one holding your address private key have the right to move your coins to another.
So if blockchain.info have your key, they can do anything with your coins.
You should use cold wallet and move your coins to your cold wallet address. Then make sure you are the only one holding the key.