To create a watch only address, you use the public key. But if you want to use an address, you create it from a private key. Did you sent the ltc to an address where you created with "Master Public Keys"? If so, then you don't have access to the address.

The other times you sweeped coins, you must have sent it to a pregenerated address.