Ehhmm, I would say that would be a good idea. Litecoin does not have as much potential upside as Bitcoin at the moment.
At the end, it depends on each individual. There is nothing wrong with the OP holding litecoin if he wants. It has shown some LITTLE BIT of progress lately and I sure will hold what I have for as long as I want cause I trust it so far. It might not have some potential as much as bitcoin since it was apparently created as the silver of bitcoin anyway, but that does not make it less better than some other altcoin.
The truth is that no one can predict the future, and the OP should just follow what his mind tells him so he can own up to his own decisions either litecoin moves up like speed of light eventually or it remains as it is.
That's what I finally decided to do: hold my LTC, buy some more of BTC... and wait and see :-)