Adding passphrase (BIP39 passphrase) to a BIP39 seed phrase will produce a different BIP39 binary seed, thus different set of keys.
So, in that temporary passphrase, you'll have access to a different wallet that can only be accessed by typing the temporary passphrase.
Think of it as a separate hidden wallet in your Ledger Nano.