|
By Daniel Finkelstein Special Correspondent
IT'S ONE of my favourite facts.
After watching Jaws, holidaymakers became significantly less likely to swim in the sea. They massively overestimated their chance of being killed by a man-eating shark.
The reason for this is something called availability bias. Dramatic events stick in the mind and we overestimate the chances that they will happen again.
So when Arsenal lost to Hull City and Stoke City, or when Chelsea drew with Hull, what were we witnessing? A real tendency for poor teams to lift their game when playing good ones?
Or a couple of games that may tell you a little about Arsenal's weaknesses or Chelsea's, but are essentially just the sort of thing we tend to see in football?
It is the controversy every week.
We assume whenever we see an upset that what we are seeing is a pattern.
Perhaps it isn't that. Perhaps all that is true is that we remember upsets but forget the much more routine event of good teams defeating poor ones.
Who - among those recalling how Phil Brown's team held Luiz Felipe Scolari's - is going to remember that Spurs were the victors against Hull on Monday?
Let's look at 'Top of Form' and 'Bottom of Form'.
The computer team has been on the case.
The basic model allows us to establish the probability of different outcomes in different games.
We take past results and weight them so that the most recent counts most heavily.
When we started, we just used goals as a measure of the quality of teams. Then we established that shots on target mattered, too.
Putting it very crudely - if two equal teams played each other on a neutral ground and the game ended in a draw, we would regard the team that had a better record with shots on target as the favourite if the teams were to replay their game immediately.
Eliminating luck
Why? Because there are more shots than goals. Therefore they provide more data, eliminating some of the luck involved in whether the ball actually goes in the net.
If Liverpool win a few games by a single goal, we may be witnessing a genuine superiority. Or they may just have got lucky. The shots data tells you that.
When we started using shots on target, it significantly improved our predictions. The shots data can help with simple analysis. But now we have done something altogether more sophisticated.
We have used the shots data over the past three seasons to establish whether underdogs lift their game when playing the big teams.
And whether the big teams, thinking that they have secured victory against a minnow, take their foot off the gas towards the end of a match.
The idea of many football pundits is that Fulham will rise proudly to the task this weekend, playing out of their skins because of the atmosphere.
And if they don't? If Arsenal amble through the game? Then at the end the Gunners will just play out the match, without really trying.
Is this true?
The first step is to establish the number of shots on target that you would expect a team to make and to concede in particular games.
This can be done by running our computer model on match outcomes. Then this data is compared to the actual match outcomes.
What we were looking for was a pattern. Was there a systematic difference between our expectations and reality? And if there was, did it vary by the type of match being played?
If it is true that poor teams up their game against big ones, we would expect to see the difference between expectations and reality at its greatest when those big teams were playing them and we would think the poor teams would shoot on target more.
If we did not find that, we would know that the whole idea was another footballing myth.
So what did we find? We analysed with each team whether the gap between expectation and reality changed depending on the difficulty of the game.
In a nutshell, the idea that underdogs up their games against the big teams is a myth. And so is the idea that big teams drop their standards after thinking that they have secured victory against small teams.
Another two myths bite the dust.
- The writer is a soccer columnist and associate editor of The Times in London. A Chelsea fan, he was awarded an OBE in 1997.
|