Maybe VAR refs should just tell the ref what to do and skip the bit where he runs off for 10 minutes to watch a tiny screen.
Even the VAR decisions turned out to be the wrong ones. The best example was of the penalty kick for Serbia, which was turned down by the VAR ref (Mitrovic kicked down inside the penalty box).
You are referring to that notorious Switzerland - Serbia match, right? The German referee Felix Brych was sanctioned and excluded from refereeing any more World Cup games by the way. The Serbian football federation made a complaint to FIFA after the match about the controversial penalty.
I don't think the VAR referees can tell the main referee what to do. They can only advise him on the situations, but they can't influence his decision. The main referee could refuse to watch the replays altogether as it happened in a couple of matches in Russia.
OK.. The referee was sanctioned and excluded. But that could do little to quell the sense of anger among the Serbs. They still feel that the match was stolen from them. On top of that, previously Serbian teams such as Partizan Belgrade were sanctioned for displaying Serb symbols. But when Xherdan Shaqiri and Granit Xhaka openly displayed racist Albanian gestures, they were let off without any match ban by the FIFA.
I always look at those kinds of situations in a bit different way. In that game, Serbia may have been damaged, but Swiss were a better team on the field. Just a little bit, but they were. They did deserve to win. It might be wrong of me to speak about their game since I am Croatian, but I really didn't have anything against them winning, I never do. I always get furious about the games where the referee damages one team that was better on the field, or was equal, or was here-there but was a "smaller" team.
I also agree that it was very wrong from Swiss players to use politics in the game.... from that point of view - maybe they didn't deserve to win after all? The players should use their charisma to calm down the political atmosphere in the stands, not to ignite it up.
In any case, VAR helps a lot but its use is still far from perfect.