I think if you don't open your wallet, mycelium will no longer rebroadcast your transaction.
Or you could just delete an unconfirmed transaction from Mycelium, so it won't get rebroadcasted anymore.
As for me, I took the advice I got in this thread and started using Electrum wallet with RBF feature It's really good and helps you not stress out about transactions getting stuck.