It wasn’t the same for both sides and often did have a lot more than a minuscule impact.
“Good at using challenges” isn’t some inherent competitive advantage that some teams are just lucky to have and some teams aren’t. The solution is to get better at using them, not just hope and pray that the randomness of umpire error evens out and doesn’t hurt us in a big game.