And I don't understand why you need a watch only wallet when you have a hardware one ?
Sorry... that is my mistake for creating the confusion about the "watching wallet"... wrong terminology

What you want to do is sync the Ledger Nano S with Electrum (it is effectively a "watching wallet", but you set it up differently)... follow the instructions from Ledger here:
https://ledger.groovehq.com/knowledge_base/topics/how-to-setup-electrum-nano-slash-nano-s"File -> New/Restore -> Standard Wallet -> Use a hardware device"... It should detect your Nano S and then sync everything from it (except the private keys of course

)
You should then be able to see all the transactions... and you should also be able to see your Receive and Change addresses etc.