Saturday, June 4, 2011

Predicting Playoff Success

It's often said that the playoffs are a different ball game as compared to the regular season - that some teams are built for the playoffs whereas others are not.

The above statement can be evaluated by looking at how well regular season results predict playoff success. This can be done by assigning a theoretical win probability to every playoff team based on how it performed during the regular season, and determining the odds for each individual matchup on that basis. If the statement is true, the favorite - the team with the superior win probability as against its opponent - should win significantly less often than expected.

My sample consisted of all 1882 playoff games played between 1988 and 2010. Theoretical win probabilities were computed on the basis of regular season goal ratio, corrected for schedule difficulty. While goal ratio is imperfect in this respect, the data required to produce more precise estimates is simply not available for the majority of the seasons included in the sample. Thus, goal ratio is the best measure available.

Home advantage was valued at +0.056, this being the difference between the expected neutral ice winning percentage of home teams (0.505), and their observed winning percentage over the games included in the sample (0.561).

After computing the odds for each individual game, I divided the data into eight categories. The category in which a game was placed depended upon the expected winning percentage of the favorite. The cutoffs for the eight categories were as follows:
  1. 0.50-0.52
  2. 0.52-0.54
  3. 0.54-0.56
  4. 0.56-0.58
  5. 0.58-0.60
  6. 0.60-0.625
  7. 0.625-0.675
  8. 0.675-1
The cutoffs were not gerrymandered so as to produce a particular result - I simply wanted each category to contain a relatively equal number of games. As there are many more games in which the favorite has a win probability between 0.50 and 0.60 than there games in which the favorite has a win probability greater than 0.60, this necessitated making certain categories larger than others.

The results:

[The italicized 'n' column simply indicates the number of games contained within each category.]

As can be seen, using regular season data allows one to predict the results of groups of individual playoff games with surprising accuracy. On the whole, the favorite did slightly worse in reality than what the regular season results predicted - 0.573 versus 0.586. However, this is probably just a reflection of the fact that regular season goal ratio is the product of both skill and luck, and that the true talent goal ratio of the average team lies closer to the population average than does its observed goal ratio.

As for the individual categories, six of the eight show a reasonably close correspondence between expected and observed winning percentage, with the other two featuring notable discrepancies. While each gap appears significant, either could be the product of chance alone. The probability of a 0.51 team going 0.468 or worse over 263 games is 0.097. Likewise, the probability of a 0.713 team going 0.671 or worse over 204 games is 0.109.

If I were to guess, I'd say that the discrepancy in the 0.675-1 category is a real effect. As discussed earlier, goal ratio tends to overvalue the favorite and underrate the underdog, and the greater the distance from the mean, the more likely this is to be true in individual cases.


Robert Vollman said...

Is it possible that there are some types of teams that consitently perform better/worse in the post-season, but that they cancel each other out in this study?

JLikens said...

In theory, yes. Although it's unlikely as it would imply a broader distribution in team playoff ability as compared to team regular season ability.

But the issue can be specifically resolved by looking at the observed spread in actual versus expected playoff wins and how it compares to what would be predicted if regular season results are a good predictor of playoff results.

That'll be my next post. said...

I have to admit that for me playoffs are more interesting and I prefer to watch them.

cheap jerseys said...

Thank you for writing informative content

Quentin said...

This is great!

jaring pengaman said...

Nice article, thanks for the information. It's very complete information. I will bookmark for next reference
jaring futsal | jaring golf | jaring pengaman proyek |
jaring pengaman bangunan | jaring pengaman gedung

Michael Twin said...

HP Colour LaserJet Pro MFP M277dw Driver
Brother MFC-9320CW Driver Download
HP LaserJet Enterprise 500 MFP M525f Driver Download
Brother MFC-8950DW Driver Download
Brother MFC-8910DW Driver Download
HP TopShot LaserJet Pro M275 Driver Download
HP Officejet 5740 Driver Download
HP Envy 7640 Driver Download
HP Envy 5640 Driver Download
HP Envy 5660 Driver Download
Canon Pixma PRO-10 Driver Download
Download Canon MP280 Driver
Canon i-Sensys LBP6230dw Driver Download
Brother MFC-8710DW Driver Download
Dell C3760dn Color Laser Printer Driver Download
Dell Color Printer C2660dn Driver Download
Canon imageClass MF212w Driver Download
Canon imageClass MF227dw Driver Download
Canon imageClass MF229dw Driver Download
Canon imageCLASS MF8210Cn Driver Download