There is no such thing as frozen coins, unless you are using a custodial third party. OP can replace his transaction with a higher fee paying transaction any time he likes.
I know there's no such thing as "frozen coins" on a non-custodial wallet but my question is, if the non-custodial wallet you use doesn't accept Replace-by-fee (RBF), can you open a new wallet that supports RPF with your seed phrase and replace the stuck transaction with a higher fee in the new wallet?