I know there's no such thing as "frozen coins" on a non-custodial wallet but my question is, if the non-custodial wallet you use doesn't accept Replace-by-fee (RBF), can you open a new wallet that supports RPF with your seed phrase and replace the stuck transaction with a higher fee in the new wallet?
Yes. Import your seed phrase to a good wallet like Sparrow or Electrum, connect to your own full RBF node or a server running full RBF, and broadcast a replacement.