Measuring the Accuracy of Baseball's Win-Percentage Estimators

Zach Fein by Analyst Written on September 06, 2008
Baseball_feature

There are several formulas out there that can be used to estimate a team's "real" record: Pythagorean Formula, Pythagenport, Pythagenpat, etc. Some use run differential and some use a run-to-runs-allowed ratio.

The question is: Which is the most accurate? The least?

Using the Lahman Database, I ran tests of 13 different methods on every team since 1921 (the end of the Dead-Ball era) to find the most accurate way to measure a team's expected record, with 1981 and 1994 excluded for obvious reasons.

The RMSE (root-mean-square-error) in the table is calculated by squaring the error (in this case, the difference of the team's actual wins and expected wins), averaging all of those numbers, then finding the square root of the average.

The formulas for each method are at the end of this article, to save space.

Here are the results.

RMSE of each method since 1921
Method RMSE
Pythagenport 3.990
Pythagenpat 3.992
Palmer-RPW 4.015
Tango-RPW 4.021
Pythag-1.83 4.022
Ben V-L 4.024
Pythag-2 4.096
RPW=10 4.104
Soolman 4.111
RPW=RPG 4.156
E.Cook 4.537
Double Edge 4.606
Kross 5.124


What's funny is that Clay Davenport, inventor of Pythagenport, denounced his method in favor of Pythagenpat, yet it is in reality the best method when compared to actual record.

Earnshaw Cook may have been the first to create a win-percentage estimator, and the Double Edge method created by Bill James was never actually used, so their finishing near last can both be forgiven.

The Kross method, on the other hand, cannot be, as it was supposedly a precise way to estimate winning percentage.

Using the Pythagenport formula, we can find out teams that have been lucky and unlucky, by comparing their actual wins to expected wins based on Pythagenport.

Single Page
(1)
...
Share This  
Crop_45x45
or to post this comment

2 Comments

There are no comments yet. Get the conversation started by leaving the first comment

Loading more comments...
posted just now
  • Loading...
  • Nobody has liked this comment yet
Cancel

This comment and all replies have been deleted This comment has been deleted Undo delete

665
reads

2
comments

written on September 06, 2008 Stats

The best newsletter on the web

Subscribe Now

We will never share your email address


CBS Sports Official Partner
Certain photos copyright © 2009 by Getty Images.
Any commercial use or distribution without the express written consent of Getty Images is strictly prohibited.