Wednesday, September 6, 2017

Explaining My Simulation Methodology

I have been meaning to get around to this for a while now and with a break in fixtures for international team games this seems like a good time to go over my simulation methodology.

 

Basics:

The model is built on this logic: that a soccer match result is determined by goals, goals are determined by the number of shots and the quality of those shots. So I have built the model and 1) trying to estimate the number of shots each team will have and 2) a rough idea of where these shots will be taken and the quality of the shots.

For simplicity I group shots into three location buckets, Danger Zone (6 yard box + Middle of 18 yard box), Wide Box (wide areas of the box) and Outside the Box.

I also estimate the number of headers that will occur in the game and I assume that all headers will be from the danger zone (about 95% of headers occur in this area) all other areas are shots from feet.

Lastly I estimate the number of Big Chances each team will have per game. For simplicity I also assume that all of these will occur in the danger zone (about 75% of big chances occur in the danger zone).

 

Determining Values:

To arrive at the values for each I have taken data from the last two seasons plus the current season. I then weight the data to get to a single value. The current weighting is 1 for 2016-17, 0.5 for 2015-16 and Games Played/19 so for this week there have been 3 matches so the weighting is 0.16 and this will go up every week.

You could certainly pick different weights for this but my thinking is that I would use last season as the baseline for each team, two years ago as half as important because there can be quite a bit of turn over in a squad in that time but still it can provide information and then a sliding scale for the current season that would put it on equal terms at the halfway point with the previous season and then have the largest weighting.

I use this weighting on the data for both offensive and defensive statistics as well as overall and home and away.

These values then feed into the simulation model to determine the number and quality of shots for each team.

Using Arsenal vs Bournemouth as an example:

Arsenal have 6.42 Danger zone shots for overall, 7.41 at home while Bournemouth allow 5.59 overall and allow 3.61 Danger Zone shots on the road. Averaging all of these I have Arsenal with a raw value of 5.69 Danger Zone shots. Taking out the expected headers and Big Chances (same methodology as above) Arsenal are left with 1.58 regular danger zone shots from feet. The decimal portion of the shot is then compared to a random number and if the decimal is higher than the random number the shots total is rounded up.

Doing this for all the different shot categories Arsenal are estimated to have 15.03 (1.58 DZ, 4.37 WB, 4.97 OB, 2.3 headers, 1.81 BC) shots but that can vary between 12 and 17 shots, compared to 10.65 (0.98 DZ, 2.29 WB, 4.32 OB, 1.78 headers, 1.27 BC) shots but can vary between 8 and 13 shots for Bournemouth.

Once the number of shots are determined each one is assigned an xG value. Danger Zone shots are 0.17 xG, Wide Box 0.06 xG, Outside the box 0.024 xG, headers 0.08xG and big chances 0.45 xG.

 

Simulating the match:

These values are assigned to each shot and compared to a random number. Again to our example:

Arsenal
Shot Type Value Random Result
DZ 0.17 0.610036 0
DZ 0.17 0.172277 0
WB 0.06 0.303131 0
WB 0.06 0.267087 0
WB 0.06 0.068808 0
WB 0.06 0.6799 0
OB 0.024 0.715029 0
OB 0.024 0.012071 1
OB 0.024 0.577135 0
OB 0.024 0.657269 0
OB 0.024 0.936911 0
H 0.08 0.356094 0
H 0.08 0.022968 1
BC 0.45 0.657358 0
BC 0.45 0.545432 0

Based on these results Arsenal would have scored 2 goals in this simulation.

This is done for both teams and the goals scored are compared and the result is recorded and then the simulation is run (with the decimals again compared to a new set of random numbers to simulate a bit of randomness that happens) again another 9,999 times. The odds that I present are the count of each result divided by the number of simulations.

Again to the example of Arsenal vs Bournemouth, Arsenal won 5,327 of the simulations, there was a draw 2,190 times and Bournemouth won 2,483 times. So the odds for the match would be presented as 53.3% for Arsenal, 21.9% Draw, 24.8% Bournemouth.

 

Simulating the Season:

For each of the remaining matches in the season the odds are determined using the above method and a similar exercise is performed to simulate the season. I use this to give odds for each team winning the league or finishing top 4 and other targets.

To help illustrate I will again use the Arsenal vs Bournemouth example. For this a random number is generated. I got 0.5058 as my random number and that is compared to odds of home win: 0 to 0.533, draw: greater than 0.533 to less than 0.753 and Away win: 0.752 to 1. With this random number Arsenal have been simulated as the winner.

This is done for each match and the number of wins, draws and losses are recorded as well as the points and where each team finished in the table. This is done another 9,999 times to simulate the season 10,000 times and then the results are presented as the simulated odds.

The latest simulation makes Manchester City the title favorites winning the title in 32.7% of simulations.

 

Team Strength:

Earlier today on twitter I posted something new and that is related to my simulation work. I called it team strength rankings.
Here is how that is derived.

Each team's overall shot spread is multiplied by the assigned values (basically it is a simplified xG value per game) and then compared to league average. Using Arsenal as an example, they have an estimated 1.8 xG per game overall compared to 1.3 for League Average. I then took the team value divided by league average times 100 to give the value in the tweet where 100 is league average and every point above or below represents 1% above or below the league average.

For the overall ranking it is the average of the offense and defense with that compared to league average to determine overall rank.

This is a new thing for me so this might need tweeking as I continue on.

Please let me know if things need further clarification or if I missed anything.

Monday, September 4, 2017

5 Highest Quality Chances from Premier League Week 3

A little slow getting this out this week but hey it's an international break and we are all kind of off our regular schedule.

Arsenal fans should probably avoid this week with the amount of shambolic defending that will be featured.

5) Harry Kane vs Burnley



Shot from feet in the center of the box, regular assisted shot, classified as a big chance: 0.40 xG.

Harry Kane just doesn't score in August.

4) Daniel Sturridge vs Arsenal




Shot from head from very close  range, assisted by a cross, classified as a big chance: 0.44 xG

That's about as wide open a header you will get. Sturridge did not miss his chance.

3) Mohamed Salah vs Arsenal




Shot from feet from very close range, following a cross, classified as a big chance: 0.54 xG

This is a really pretty movement from Liverpool to carve open Arsenal, Petr Cech makes a great save to deny a goal. 

2) Dele Alli vs Burnley



Shot from feet from very close range, following a corner, classified as a big chance: 0.76 xG

1) Mohamed Salah vs Arsenal 



Shot from feet from the center of the box, following a fast break, classified as a big chance: 0.77 xG

Not the best corner from Arsenal, a great one man fast break from Salah.

Thursday, August 31, 2017

Arsenal's Squad Mismanagement

I am doing a bit of change of pace post today away from stats to look more at Arsenal. In particular there poor squad management and the coming squad rebuilding job.

Here is a look at the current Arsenal Squad and the contract lengths(according to transfermarkt)

I have shown the length of each players deal and the age that they will be in that season. I have also highlighted the peak years (24-28) green and put players over 30 in red.

Arsenal have six senior players out of contract at the end of the season (and it would have been 7 with Alex Oxlade-Chamberlain getting sold yesterday). The running down of contracts for Per Mertesaker and Santi Carzorla make a certain amount of sense. For the rest it is absolutely stupid to hold on to a player this late with no chance of getting a return for them.

This situation is bad but what is worse is that next season a further ten players will be in their last season.

Arsenal are going to be in an even more desperate spot next summer. It will have teams circling looking to pick off our best player plus the team will be further weakened with our two major stars in Alexis Sanchez and Mesut Ozil gone(they aren't extending). Further making things challenging Arsenal are likely to be sitting outside the top four again (52% chance of 5th or worse according to my last simulation) and without champions league football to attract players. Oh and their manager will be in the last year of his contract with questions on the long term direction of the club in question.

A couple of those guys with two years to go on their contracts, like Petr Cech and Nacho Monreal are still solid contributors that would not bring a return in the market so it makes financial sense to keep them around but not extend their contract but these are the exceptions. The other guys above with two years left? Yeah decisions should have been made on them last season whether they had a future or not at the club and moved on while they had good market value.

Well run teams make decisions on these players at this point. If you decide they aren't in the long term plans you can still extract value in the transfer market. If you decide to extend the allure of running down the contract to enter free agency is still three years away so that is a less appealing option.

The other major issue for Arsenal is that for all the attacking talent in the team, they are seriously short in players with promise who are pre-peak or just entering their peak ages to take over for older players.

Beyond Alex Iwobi who is near the first team that looks like they could be a starting player. Sure Reiss Nelson looks promising but he is 17 and doesn't have much first team experience but could get it this year but beyond that? Not much.

Let's play director of football and go through the players with two years left and take a look at them.

David Ospina: He is clearly the second choice and not the ideal long term solution to Arsenal's goal keeping question. 29 this season and two years on his deal. Ideally he would have been sold last season but definitely should have gone this summer. His wages as a starting goal keeper for an international team are probably fairly high for a guy who will start in low importance cup games.

Matt Macey: I have no real opinion on his quality but as the third keeper he is probably on a low wage. Probably behind Emi Martinez in the pecking order. Maybe sell but not really a concern as the third keeper.

Nacho Monreal: A solid player still but not a guy that I want extended. He gets picked out to be exploited by high quality wingers not a convincing center back. He can do a passable job at both positions still against average opponents and wouldn't return much of a transfer fee. Keep for depth.

Mathieu Debuchy: Replaced by Hector Bellerin, Arsenal have been trying to offload him for a the last couple years without success. Really should explore doing an NBA style buy out for him just to get him away from the club.

Aaron Ramsey: A good player who suffers from injury issues and not really fitting into the system. If he is going to stay you probably need to build around him to maximize his talents if you don't want to do that he arguably makes the team weaker when he abandons the midfield to play as a second striker too often.  Arsenal should have made the decision on him last year to sign or extend. With the window over he is going to stick around and be in the same position Ozil, Alexis and Chamberlain were in. I probably would have extended him, switched to a 4-3-3, sold Ozil and brought in more midfield depth and let him do his charging runs but with more cover behind him.

Theo Walcott: Fine player, doesn't fit with how Arsenal play. Sell him as he is running down the contract and getting past the peak years. Probably should have left last year to maximize return and allow for money to be re-invested in a younger replacement.

Oliver Giroud: The guy scores goals and has pretty flicks and layoffs but isn't a starter. Teams were offering transfers in the 30 million range for him and Arsenal should have been ruthless and let him go.

Danny Welbeck: Does everything well expect finish moves to produce goals. However that is important as a striker. With this is clearly a rotation option, I like him and think that he is someone to keep around. The age profile is still good and I would have looked to try to see if his contract could be extended a couple years.

Chuba Akpom: Not rated by the manager. Sell.

After that exercise Arsenal moved on at least four players and bought one out to clear out space on the roster. It also freed up £250,000 £300,000 a week in salaries plus some transfer funds to go to replacements and to allow for money to go to extensions.

Doing this exercise helps the team to clear out players who don't have a clear future, it helps to avoid the issues that Arsenal currently have with the Premier League FFP rules. With Arsenal bumping into the top of the new soft cap in the Premier League it is even more important to maximize the output that you get for the salaries that you pay your squad. In this kind of a situation having a lot of good squad players kills long term roster flexibility. This is also an indictment of Arsenal's commercial department failing to keep up allow for more salary flexibility.

Young players are rejecting Arsenal. The current players plus management have backed Arsenal into a corner with an aging squad with little resale value and contracts running down. There doesn't seem to be a plan for next year let alone one for three or four years down the road.

Things are likely to get worse and it could take years for Arsenal to get out of this whole. We can all hope that this doesn't permanently knock Arsenal down from the top tier of the Premier League.

Friday, August 25, 2017

Premier League Week 3 Projections

Week three of the Premier League is here and even though the transfer market is at the forefront with the window closing there are games to be played and projections to be made.

This week there are even more close match ups and just one game with a team expected to win over 50% of the time.

For Arsenal things could really meltdown for the fans with going to Anfield as underdogs. A second loss in a row plus the expected inactivity on the in goings in the transfer market could see things turn absolutely toxic among the fan base.

Lastly here is the latest full season projections:
Click to enlarge
The title race has tightened up with Manchester City drawing against Everton last weekend combined with Manchester United's second 4-0 win and Liverpool also winning. Arsenal's loss at Stoke saw them drop from second title favorites to the sweet comfort of 4th.

The race for top 4 is incredibly tight, with ten teams with at least a 10% chance of being a part of that group. Chelsea have seen their odds drop the most since the start of the season going from 46.8% pre-season to 38% this week while Manchester United have improved their odds the most going from 45.9% to 61%.

In the relegation battle, there are seven teams with at least a 15% chance of going down. Newcastle have moved to joint worst odds with Brighton after two losses to start the season. Newcastle has seen their relegation odds increase 23% since the preseason projection going from 32% to 55%. If Newcastle can't get at least a point against West Ham at home the season might be in jeopardy of being over for them.
-
This article was written with the aid of StrataData, which is the property of Stratagem Technologies. StrataData powers the StrataBet Sports Trading Platform, in addition to StrataBet Premium Recommendations.

Tuesday, August 22, 2017

5 Highest Quality Chances from Premier League Week 2

I really liked how this turned out last week so I am going to go through this again.

These are the top 5 highest quality chances produced in the Premier League this week with the inputs that went into them and the xG for each chance.

5. Richarlison vs Bournemouth




0.60 xG: Shot from feet, from very close range, from open play, classified as a big chance.

Not all high quality shots are pretty, this helps prove it.

4. Ben Mee vs West Brom



0.61 xG, Shot from head, from very close range, from a corner, assisted with a cross, classified as a big chance.

Headers are hard part 1.

3. Phil Jones vs Swansea City



0.65 xG: Shot from head, from very close range, from a set piece situation, assisted with a cross, classified as a big chance.

A beautiful delivery from Juan Mata on this free kick. Headers are hard part 2.

2. Joel Matip vs Crystal Palace



0.65 xG: Shot from head, from very close range, from a set piece situation, assisted with a cross, classified as a big chance.

Headers are hard part 3.

1. Eric Bailly vs Swansea City



0.79 xG: Shot from feet, from very close range, from a corner, classified as a big chance. 

This is probably underestimating the chance quality because just getting his foot to the shot pretty much means that this is a goal. For those curious Paul Pogba's free header that was saved was a 0.25 xG shot.

Friday, August 18, 2017

Premier League Week 2 Projections

Week two of the Premier League is here and I have a fresh batch of projections.
This week there are many more close match ups and just a pair of odds where teams would be expected to win over 50% of the time compared to four last week (not including two matches at over 49%). 

The marquee match of Tottenham vs Chelsea shows Spurs as the clear favorites and that doesn't even take into account the players that will be out for Chelsea. It will be interesting if Antonio Conte can pull some magic out of the hat in that match. The midfield that he picks sure will be interesting. 

For Arsenal they are away at Stoke and have pretty favorable odds. My gut would not put things that high up but this week Arsenal should hopefully have more senior players available to play at center back and hopefully Alexis back to at a minimum the bench. I also hope the Oliver Giroud continues as a sub, he is so good at that and really changes the game against tired defenses but really messes with the offensive flow as a starter.

Lastly here is the latest full season projections:
Click to enlarge
Manchester City saw their title odds improve 5% after the results of last weekend to be the biggest gainer, while Chelsea lost nearly 4% with their shocking defeat against Burnley. Arsenal have slipped their way into the second highest average points spot but there is such a narrow grouping among the top teams that will probably switch quite a bit as the early season plays out.

In the relegation fight, Burnley were huge movers going from 45% relegation to 30% relegation with a win against the defending Champions with Huddersfield getting a 9% bump with their opening win. Crystal Palace were the big dropper of the week and could be in serious trouble with starting the first two matches with 0 points and real danger lurking with a trip to Anfield.

Also the rest of the big leagues will be kicking off this weekend. For those that follow my stats I want to give an update on my updating schedule. I usually update the Premier League first on Monday morning Pacific Time and then get the rest of Europe as team permits and that some times stretches into the week. I try to get all the stats updated by the time that games kickoff for Fridays but I will try to have it done earlier than that.
-
This article was written with the aid of StrataData, which is the property of Stratagem Technologies. StrataData powers the StrataBet Sports Trading Platform, in addition to StrataBet Premium Recommendations.

Wednesday, August 16, 2017

Napoli vs Nice First Leg Champions League Playoffs Simulation

After the thrilling Hoffenheim vs Liverpool playoff matchup yesterday, today we have the second of the big match up in the playoffs to get to the group stage of the Champions League in Napoli vs Nice.

My simulation model (which I think I will go into depth on as tomorrow's post) thinks that Napoli is a big favorite to win this match. I should also point out that Nice's stats are really pretty mediocre and that they rate on stats as a midtable French team but last season they really overperformed and finished in third.

The Nice coach Lucien Favre has a bit of a track record in doing this for the teams that he coaches.