Right, because everybody always has the exact same opinion on a decision once we've seen the replay.
There'll still be plenty of controversy, video refs will make decisions people don't agree with as a huge percentage of decisions are subjective.
What this could cut out, however, is blatant cheating and absolute refereeing howlers that cost teams games when everyone can see an injustice has been done. I've no idea why anyone would be against it in a sport so badly littered with cheating.
I don't get the romanticization of massive errors by refs and people saying they are part of the game.