Noooo I'd leave it installed if you're skeptical of it though you could use it on a different browser than your main one or just limit its permissions (if that's possible - eg metamask wanting the ability to read the websites you load or access the clipboard).