Now I tried to move the rest of my coins to another wallet but each time I send a particular token it goes to the contract address. So I'm literally sending my coins to the token contract meanwhile I had already input the new address.
What is the contract address you are referring to? Let's take a look.
Or maybe it was just your thought and you are actually sending on another address that you think the copied address of yours.
As suggested, make some transfer instead on other device/machine.