RBF is enabled but there is no option to increase the fee in the context menu in Electrum.

I guess I'm supposed to use the mempool accelerator then?

Maybe I just wait. The fee was 8.3 sat/vB btw which is low/mid priority according to MEMPOOL.