October 9, 2014

The Eye of the Umpire

Earlier today Rob Neyer sent out this tweet about Joe West working the ALCS:

If you follow the tweet to the chart on umpire accuracy, and go to page four, you’ll see called 2399 of 2859 pitches correctly, 83.91%. There are 89 umpires listed in the chart, meaning the 45th umpire is the median ump. That’s Larry Vanover, who comes in at 86.38 percent. So the question I want to ask is, was Joe West really just the median umpire having a bad year? That is, what evidence do we have that his calling is just due to a year of bad luck? He might have had a lot more close pitches than other umpires, for example.

So we can ask the question, “If West’s ability was equal to the median umpire, what is the probability of him getting no more than 2399 pitches out 2859 pitches correct?” The answer is 9.20E-05, or 0.000092. That’s very low.

Another way is to calculate the 95% confidence index. For West as the median umpire calling 2859 pitches, that would be 2433 to 2505 called correctly. West is well below the 95% confidence range, nearly three standard deviations from the mean.

So balls and strikes is not his strong suit. Does anyone have any data on how often Joe West calls were subject to instant replay challenge, and how often they were overturned? If those numbers are bad as well, it makes one wonder why is umpiring in the post season.

3 thoughts on “The Eye of the Umpire

  1. Scott Segrin

    I don’t think it takes a whole lot of data and calculations to wonder why Joe West is umpiring in the post season.

    ReplyReply
  2. Hans

    So, it’s a significant difference, but is it substantial? Meaning, what’s the WAR value of that many additional strikes? If it’s less than .5, it’s not making that big of a difference.

    While the difference between 85% and 83% may be significant because you’ve got such a large sample of pitches that each umpire sees, I have a hard time believing that it’s that big of an effect.

    ReplyReply
  3. Joseph Finn

    “So balls and strikes is not his strong suit.”

    You mean the bare minimum of his job is not his strong suit? That sounds about right for Joe West.

    ReplyReply

Leave a Reply

Your email address will not be published. Required fields are marked *