Building Your Own Team Rating System

Just before the 2nd Round of 2008 I created MAFL's Team Ratings System, MARS, never suspecting that I'd still be writing about it 5 years later. At the time, I described MARS in the newsletter for that week in a document still available from the Newsletters 2005-2008 section section of this website (it's linked under the "MAFL The Early Years" menu item in the navigation bar on the right of screen). Since then, MARS, as much to my surprise as I think to anyone's, has been a key input to the Line Funds that have operated in each of the ensuing years.
Read More

How Good Are Hawthorn, How Poor GWS?

Without the benefit of emotional and chronological distance it's often difficult to rate the historical merit of recent sporting performances. MAFL's MARS Ratings, whilst by no means the definitive measure of a team's worth, provides one, objective basis on which to assess the teams that ran around in 2013.
Read More

Really Simple Margin Predictors : 2013 Review

MAFL's two new Margin Predictors for 2013, RSMP_Simple and RSMP_Weighted, finished the season ranked 1 and 2 with mean absolute prediction errors (MAPEs) under 27 points per game. Historically, I've considered any Predictor I've created as doing exceptionally well if it's achieved a MAPE of 30 points per game or less in post-sample, live competition. An MAPE of 27 is in a whole other league.
Read More

To Win A Grand Final You Must First Lead

History suggests that, as the higher-Rated "Home" team, Hawthorn must lead early and lead well if it is to be confident of success in Saturday's Grand Final, and not assume that its superior Rating will allow it to come back from any substantial deficit.
Read More

The Relative Importance of Class and Form in AFL

Today's blog is motivated by a number of things, the first of which is alluded to in the title: the quantitative exploration of the contributions that teams' underlying class or skill plays in their success in a given game relative to their more recent, more ephemeral form. Is, for example, a top-rated team that's been a little out of form recently more or less likely to beat a less-credentialled team that's been in exceptional form?
Read More

Bookmaker Overround: Relating Team Overround to Victory Probability

In the previous blog I described a general framework for thinking about Bookmaker overround.

There I discussed, in the context of the two-outcome case, the choice of a functional form to describe a team's overround in terms of its true probability as assessed by the Bookmaker. As one very simple example I suggested oi = (1-pi), which we could use to model a Bookmaker who embeds overround in the price of any team by setting it to 1 minus the team's assessed probability of victory. 

Whilst we could choose just about any function, including the one I've just described, for the purpose of modelling Bookmaker overround, choices that fit empirical reality are actually, I now realise, quite circumscribed. This is because of the observable fact that the total overround in any head-to-head market, T, appears to be constant, or close to it, in every game regardless of the market prices, and hence the underlying true probability assessments, of the teams involved. In other words, the total overround in the head-to-head market when 1st plays last is about the same as when 1st plays 2nd.

So, how does this constrain our choice of functional form? Well we know that T is defined as 1/m1 + 1/m2 - 1, where mi is that market price for team i, and that mi = 1/(pi(1+oi)), from which we can determine that: 

  • T = p1(o1 - o2) + o2

If T is to remain constant across the full range of values of p1 then, we need the derivative with respect to p1 of the RHS of this equation to be zero for all values of p1. This implies that the functions chosen for o1 and o2 must satisfy the following equality: 

  • p1(o1' - o2') + o2' = o2 - o1 (where the dash signifies a derivative with respect to p1).

I doubt that many functional forms o1 and o2 (both of which we're assuming are functions of p1, by the way) exist that will satisfy this equation for all values of p1, especially if we also impose the seemingly reasonable constraint that o1 and o2 be of equivalent form, albeit it that o1 might be expressed in terms of p1 and o2 in terms of (1-p1), which we can think of as p2.

Two forms that do satisfy the equation, the proof of which I'll leave as an exercise for any interested reader to check, are: 

  • The Overround-Equalising approach : o1 = o2 = k, a constant, and
  • The Risk-Equalising approach : o1 = e/p1; o2 = e/(1-p1), with e a constant 

There may be another functional form that satisfies the equality above, but I can't find it. (There's a rigorous non-existence proof for you.) Certainly oi = 1 - pi, which was put forward earlier, doesn't satisfy it, and I can postulate a bunch of other plausible functional forms that similarly fail. What you find when you use these forms is that total overround changes with the value of p1.

So, if we want to choose functions for o1 and o2 that produce results consistent with the observed reality that total overround remains constant across all values of the assessed true probability of the two teams it seems that we've only three options (maybe four): 

  1. Assume that the Bookmaker follows the Overround-Equalising approach
  2. Assume that the Bookmaker follows the Risk-Equalising approach
  3. Assume that the Bookmaker chooses one team, say the favourite or the home team, and establishes its overround using a pre-determined function relating its overround to its assessed victory probability. He then sets a price for the other team that delivers the total overround he is targetting. This is effectively the path I followed in this earlier blog where I described what's come to be called the Log Probability Score Optimising (LPSO) approach.

A fourth, largely unmodellable option would be that he simultaneously sets the market prices of both teams so that they together produce a market with the desired total overround while accounting for his assessment of the two team's victory probabilities so that a wager on either team has negative expectation. He does this, we'd assume, without employing a pre-determined functional form for the relationship between overround and probability for either team. 

If these truly are the only logical options available to the Bookmaker then MAFL, it turns out, is already covering the complete range since we track the performance of a Predictor that models its probability assessments by following an Overround-Equalising approach, of another Predictor that does the same using a Risk-Equalising approach, and of a third (Bookie_LPSO) that pursues a strategy consistent with the third option above. That's serendipitously neat and tidy.

The only area for future investigation would be then to seek a solution superior to LPSO for the third approach described above. Here we could use any of the functional forms I listed in the previously blog, but could only apply them to the determination of the overround for one of the teams - say the home team or the favourite - with the price and hence overround for the remaining team determined by the need to produce a market with some pre-specified total overround.

That's enough for today though ...

Bookmaker Overround: A General Framework

Previously I've developed the notion of taking a Bookmaker's prices in the head-to-head market and using them to infer his opinion about the true victory probabilities of the competing teams by adopting an Overround-Equalising or a Risk-Equalising approach. In this blog I'll be summarising and generalising these approaches.
Read More

Team Ratings, Bookmaker Prices and the Recent Predictability of Finals

Last weekend saw three of four underdogs prevail in the first week of the Finals. Based on the data I have, you'd need to go back to 2006 to find a more surprising Week 1 of the Finals and, as highlighted in the previous blog, no matter how far you went back you wouldn't find a bigger upset than Port Adelaide's defeat of the Pies.
Read More

Prime Motivation: An Analysis of Prime Numbers in AFL Scoring

Earlier this week, the TED talk of Australian radio broadcaster, comedian and self-confessed number geek Adam Spencer was posted online. In it he explains his fascination with prime numbers, in particular the discovery of "monster primes", which got me to wondering about the prevalence of prime numbers amongst football scores.
Read More

Is Class More or Less Important In AFL Finals?

You'll hear it said about sport that class emerges when it's needed most. If that applies to football then you'd expect that better teams would be more likely to win games in the Finals than they are games in the regular home-and-away season.
Read More

Game Margins and the Generalised Tukey Lambda Distribution

The Normal Distribution often turns up, like the Spanish Inquisition, in places where you've no a priori reason to expect it. For example, I've shown before that bookmaker handicap-adjusted margins appear to be distributed Normally.
Read More

The Predictability of Game Margins

In a recent blog post I described how the results of games in 2013 have been more predictable than game results from previous seasons in the sense that the final victory margins have been, on average, closer to what you'd have expected them to be based on a reasonably constructed predictive model. In short, teams have this year won by margins closer to what an informed observer, like a Bookmaker, would have expected.
Read More

The Predictability of 2013

Friend of MAFL, Michael, e-mailed me earlier to ask about my claim that 2013 was on track to be the most predictable MAFL season ever, pointing out, quite correctly, that bookmaker favourites have been winning at about the same rate - perhaps even at a slightly higher rate - as they had been at the same time last year.
Read More