If you current wallet does not support RBF at all as you say, then you should definitely change to a better wallet. Opt in RBF has been the standard for years. I would worry about what security updates your wallet software is missing if they have been unable to implement such a basic feature at any point in almost a decade.