If i reset it, does it give totally new address space, which is not related to old addresses at all?
If you reset and create a new wallet, yes.
Can average joe, exchange, tax man, anybody figure out that those old and new addresses are from same Ledger Nano S?
No. They can't even know that those addresses belong to a Ledger Nano S wallet.