Just the install folder.
You have to delete everything in Gridcoin install dir and reinstall Gridcoin from MSI, sometimes the upgrade command doesn't fully upgrade.
Thanks for helping. I suppose I have to delete both the "Gridcoin" folder in Program files and "Gridcoin" from AppData/Roaming?