So I found the problem, the fees automatically charged by electrum xvg wallet were not high enough. (it was 1.4)
I put 5 and my transaction went through.
They have a telegram group called XVG-Wallet-support, this is where I found the answer to my problem.