February 7, 2016

Programmable Umpires

Via BBTF, computers are programming human umpires:

But improve is what umpires have done every year since we’ve had access to robust PITCHf/x data. When you plot out every pitch umpires had to call a ball or a strike from Baseball Savant and judge accuracy using its strike zone definition, the consistency of this improvement stands out immediately. Over the past seven seasons, umpires have improved their accuracy by 0.37 percentage points each year, a value that seems negligible until you work out that over the course of the season the decision to call a ball or strike comes down to the umpire on roughly half of pitches thrown. This represents more than 350,000 strike zone judgement calls home plate umpires, as a group, must make each year.

This is not new information. Over the past few years, these same data have been mined to draw a similar conclusion. While the strike zone may have succumbed to gravity over the past several seasons, overall umpires are calling the true strike zone more accurately with every year.

Humans have excellent pattern recognition skills, and incentives can make them even better. Robots, rather than calling the strike zone, are training the umpires to do a better job. So by the time we build robots capable of calling the strike zone accurately, the umpires might be just as good!

There’s also a chart that shows younger umpires are better at this than older umpires, since they likely aren’t set in their ways. So progress should continue as the older umpires die out.

There is a problem with this, however. Every once in a while, MLB needs to change the strike zone to balance offense and defense. For a robot, it’s changing a constant. For a human, it’s retraining. Now, I suspect the retraining will take place faster than in the past, but it takes a while to get rid of the bias of the old strike zone.

1 thought on “Programmable Umpires

  1. pft

    The problem is that balls are still being called strikes at about the same rate. There has been almost no change there. The only improvement has come with strikes being called balls. In other words, the umpires improvement has been biased and geared toward taking offense out of the game.

    That cant be an accident. The take out is that MLB’s training has been geared to remove offense.
    Why? Thats the question.

    Now as for “changing the strike zone”, there is no reason to do so. The strike zone was last change in 1995 and has been very offense friendly until MLB training /evaluation under pitch f/x. It may very well be pitch f/x is not as accurate as we think and may be biased on the low side. In other worse, that +/- 1 inch accuracy they claim may not be equal between the top, sides and bottoms.

    From this article you can see in 2010 that 19 of the 30 parks showed a negative error vertically and only 8 had a positive bias. 3 were neutral. In 22 parks the average negative bias was 0.5 inch

    http://www.baseballprospectus.com/article.php?articleid=13109

    All they have to do is tweak the algorithm to compensate for the inaccuracy and to achieve the desired zone

    ReplyReply

Leave a Reply

Your email address will not be published. Required fields are marked *