40k Editorial: ‘Ard Boyz Preliminary Results – Some Statistics
‘Ard Boyz round one has come and gone. Let’s do some data mining!
I live in Australia (so now you all know, again) so don’t have to deal with the crazy shenanigans Games Workshop tries to pull (i.e. last year’s missions) with ‘Ard Boyz. A few authors from 3++ is the new black did go however and we did do quite a few army list reviews. I’m also a statistical nut so did some data mining to see what we could uncover. This year’s missions were a lot better but it appears turnout was quite a bit lower though this is based upon hearsay. 2500 points is a very different kettle of fish compared to the common 1750-2000 points played at tournaments. Many armies have issues scaling up to 2500, specifically older books with less options. Many individuals have little to no experience at 2500 points or don’t have an army for that level and have to cobble together an actual list at 2500. Remember, simply taking 1750-2000 armies up to 2500 doesn’t always work. Many 2000 point armies have near maxed out the Force Organisation Chart and thus need to be completely re-worked. When looking at said statistics, please keep this uniqueness in mind.
Quick note: this article is very similar to the one on 3++. The major difference being some subjective observations at the end and an increased sample size. Also, in case you don’t get it – yes these are flawed statistics beyond the issues one has in actually running analysis on wargames. This is mentioned and thus any conclusions drawn are not really conclusions, but observations.
I noticed a neat graph over at Danny Internet’s Bald and Screaming (he assures me the malware is gone) and got more data to expand it. I used the same initial source Danny used, the Dakka forums, as well as blogs and friends over in the States. Yes, I cross-checked data/stores to make sure I wasn’t counting things twice. Now, as we recall using tournaments as proof of an army doing well has a lot of issues. Messanger of Death has started looking at these for me but suffice to say there are just too many variables one cannot account for. This makes determining the validity of tournament results very difficult. Not only do we not always have all the match-up data but we don’t always know exact army lists, terrain (and what armies were matched up on what terrain), dice, player ability, personal factors such as fatigue, etc. TO rulings outside of the ruleset (they happen), number of people using certain armies, not to mention soft scores, battle points and so on.
Some Baselines
Now this graph is only based on a certain sample of ‘Ard Boyz results and does not have the number of total armies represented. For all we know only seven Tau players could have showed up and all of them placed. Unlikely but a statistical possibility. We can make some assumptions though. For example:
- Grey Knights very likely had the highest number of participants – flavor of the month and all that. If not the highest certainly one of the highest.
- 5th edition books are more likely to have higher number of players – fit the new ruleset better, new models, rules, etc.
- Older books very likely had less participants due to older rules, less models, more expensive armies (i.e. all metal), etc.
Kirby’s graph |
Danny Internet’s graph |
Data “THOUGHTS”
I’ve included both my (133 sample locations) and Danny’s (87 sample locations) graphs – his of course looks prettier. So what do we see?
- Grey Knights have an edge on everyone else. I would put this down to more people playing them, not everyone is used to them and thus could be beaten by the unknown army factor and that they are a good army. Would I say they are the best and worthy of smashing everyone in these rankings? No and I think these factors contribute to their higher placing total.
- If we assume Grey Knights got several extra placings from being new, there appears to be a clear divide between having a good codex and a not so good codex. From Space Wolves across to Orks there is no significant difference in terms of placings from one book to the next. This includes, Space Wolves, Dark Eldar, Blood Angels, Space Marines, Imperial Guard and Orks. This last army is of course the ‘anomaly’ in being an army which has a difficult time against 5th edition mech armies yet still placed well.
- We can further this by saying there appears to be three ‘tiers’ – good armies, okay armies and crap armies. I would hesitate towards this though as some armies I would consider good, such as Black Templars and Tau, are more likely to be influenced by external factors – i.e. older book so less players, 2500 points is harder for older books, etc. That being said, it appears that Eldar, Tyranids and Dark Angels are ‘middle of the run’ armies who probably do well against the worse books but are on the back foot versus the good books.
- There is comparability between the two graphs. Only Black Templars and Blood Angels move up in terms of placings compared to other armies (jumping Tau and CSM for BT and Dark Eldar for BA) and there does seem to be a group of “better” armies. In my graph with more samples, Space Wolves clears the pack just a little bit more. Those 5th edition armies, excluding Tyranids, all seem to do relatively well compared to each other across graphs with the added anomaly of Orks.
- Some armies appear to be much worse than others. We know Tau, Black Templars and Immo-spam Witchunters are all pretty good but don’t appear to place well in these rankings. Tau suffer at 2500 as we know which is a good explanation for why they don’t place highly here and the rest of the low-end result armies you don’t actually see often and when played, are often by “old school” types who are more into backstory than gaming (this is a generalisation). We can tentatively conclude though that many of these books suffer against their 5th edition brethren even if they do have some perks.
- Despite perhaps having the best 2500 options available to them in terms of balanced lists, Imperial Guard didn’t do significantly better than their 5th edition counter-parts.
Now these results are hard to actually extract information from in terms of statistical validity – just look at the list of problems mentioned in the first paragraph. It does hint towards some things though.
- 5th edition is actually pretty damn good in terms of balance and Games Workshop has done a very good job with their army releases in terms of external balance.
- Tyranids were the 5th edition flop.
- 5th edition books > 4th edition books. This we already knew so we have some concurrent validity going on here.
- Minimal evidence of codex creep. I know people love to say that each new codex is the best and whilst Grey Knights have significantly more placings than the other armies, this result is more than likely from a higher number of participants. If we look past Grey Knights however, we appear to see clumping rather than a linear progression of armies based loosely on release date indicating as in point 1, that the books in 5th edition are quite comparable to each other.
- Orks placed mostly as Horde armies. I and many others have commonly pointed out that Orks have serious issues in 5th edition and would have expected them to place more in line with Eldar/Tyranids. The horde factor potentially threw a lot of people off who tried to ‘meta’ for mech.
- A lot of unusual lists were played in terms of rock-paper-scissors which will skew the results somewhat. There were a lot of Paladin deathstar lists placing for example.
- Few people seem to be using Marines outside of Vulkan. This is sad as Bikers and regular old Mech do well.
- The DA/BT FAQ had a huge bearing on Dark Angels in terms of placings and not so for Black Templars even though I would suggest BT is the better army with more codex options available as well.
- I saw no foot Imperial Guard lists place at all – most foot lists were Space Wolves, Blood Angels, Tyranids, etc.
- There were quite a few locations with only a handful of players – this would obviously skew the results slightly.
From a meta-evolution point of view its interesting to compare the participant chart above to the WargamesCon participants chart from last month here. Have at it.