If I understand correctly, you already have funds in your normal wallet so if you were to add a passphrase to your used seed phrase, it'd just lead to an empty passphrase-protected wallet!
^{- This should be done when you're setting up your wallet for the first time, but only do it if you "fully" understand everything about it.}