I'm feeling the same way. I wish I'd bought some Bitcoins back when they were fresh. LTC may or may not take off like BTC has, but it couldn't hurt to have a few of them just in case.
Fundamentally, crypto-currencies should be valued by their user base, so Litecoin would only take off with an increase in user base. Though, we may see a significant increase in user base with none ASIC miners moving to Litecoin.