Do you have your 24 words (that were given to you when you first turned your Ledger on) written down?
If that is the case, then you have nothing to worry about when resetting your wallet, as all of your addresses are generated from that (you might need to create a new LTC account afterwards, though).
It's highly unlikely that you'll need to reset it, though.
Are you sure that you're using the correct BTC account (there can be multiple accounts with multiple addresses generated from them, all from a single seed)?
Does the address ever show up in your wallet right now?
Also, it's possible that you're using the old Litecoin address format (do your Litecoin addresses start with an M or a 3?).
If you have sent Bitcoin to a Litecoin SegWit address, it's still possible to recover that (although rather quirky).