... so he would recover the non-passphrase wallet, but by doing so, it does not mean the passphrase wallet is now inaccessible to the victim ( who still knows the passphrase + 24 words )
Take note that the two wallets (the one without passphrase and the one with passphrase) are two different wallets with completely different addresses. Anything that happens to each of these wallets doesn't affect the other wallet.
Someone who has access to your seed phrase and doesn't know the passphrase can't have access to the wallet that is protected with a passphrase. You will be able to import your seed phrase and the passphrase in another wallet and access the fund.
Yes OK, thanks for clarifying... the wallet with passphrase is independent... still accessible even if the wallet without passphrase is recovered/stolen.