There were another two Kotei this weekend, but the non-reports are starting to build up (by the time things were wrapped up last year, I think there was only one Kotei that we aren’t able to get full data for, so hopefully we’ll get there again this year).
If you’re tracking the data closely, you’ll that the total number of players in this week’s data actually went down compared to last week’s. This is because, in last week’s data, I somehow managed to pull the Atlantic City data a second time, instead of the Szczyrk data. The Atlantic City Kotei was so big that one copy of it is more players than adding back in the Szczyrk data and the Louisiana data from this weekend (as of the time I’m writing this, we don’t have the full data for the Athens, Greece Kotei).
You may note that there is now a chi-square value in the table, replacing the “relative chance of making cut” column, but serving a similar function (note that all calculations in this column exclude unaligned players). The number is the standardised residual, or the square root of the chi-square value for that clan’s number of players put into the cut (taking into account player population). A higher absolute value in this column indicates a greater deviation from an average rate of making the cut – positive numbers means the Clan had a higher rate, negative numbers mean the Clan had a lower rate (note that the mean chance for a player to make the cut is not the same as the number at the bottom of the “% Made Cut” column, as that number is the average by Clan, not by player). The range from -1 to 1 is within 1 standard deviation of the mean. Anything above 1 or below -1 is an indication that the deviation is more than chance. Anything at or above 1.96, or at or below -1.96, indicates a 95% confidence that the deviation indicates that the faction is question is not balanced. Note that this test of statistical significance will tend to show fewer “unbalanced” clans than many players would identify. Numbers with a 95% (or better) confidence as “unbalanced” are marked in bold – with this data set, it only applies to Crab (on the high end) and Crane (on the low end).
There is an additional number in the final row of the column. This is not any sort of average or sum of the numbers above it. It is, instead, the standardised residual for the environment as a whole. Because the environment as a whole, across all nine Clans, has many more degrees of freedom, a higher number is required to achieve the same degree of confidence. For this data, a number of ~3.94 or higher indicates a 95% confidence that the environment is not balanced. When the number in this data block meets this threshold, it wll be marked it bold (it does not meet the threshold this week).
I have said it before, but let me say again that what, exactly, one makes of this data is up for discussion. In particular, I think it takes some thought what exactly it means to say that there is a 90 or 95% confidence that there actually is an unbalanced environment. This particular threshold may not mean a ton, since it’s not like the null hypothesis of a perfectly balanced environment is one that (IMHO) one could reasonably expect to be possible, much less true. So, for this number in particular, there may be more to be gleaned from comparing the number across environments than in looking at the particular value for a particular environment. And for particular Clan values, there is still a potentially useful comparison point – even if neither one crosses the threshold, you’re still probably on safe ground within this context saying that a Clan with a value of 1.9 is stronger than a Clan with a value of -1.9.
Of course, if any of the math-savvy in the audience spot any errors in my math below or explanation above, feel free to correct and/or clarify.
| Emperor Edition Environment | ||||||
| Players | % of Field | Made Cut | Won | % Made Cut | Chi-Square Standard Residual | |
| Crab | 191 | 15.3% | 58 | 5 | 30.4% | 2.59 |
| Crane | 102 | 8.2% | 11 | 0 | 10.8% | -2.36 |
| Dragon | 132 | 10.6% | 30 | 6 | 22.7% | 0.27 |
| Lion | 152 | 12.2% | 40 | 3 | 26.3% | 1.24 |
| Mantis | 129 | 10.3% | 27 | 4 | 20.9% | -0.17 |
| Phoenix | 123 | 9.8% | 32 | 2 | 26.0% | 1.04 |
| Scorpion | 156 | 12.5% | 29 | 2 | 18.6% | -0.82 |
| Spider | 114 | 9.1% | 17 | 1 | 14.9% | -1.54 |
| Unicorn | 135 | 10.8% | 23 | 1 | 17.0% | -1.15 |
| Unaligned | 16 | 1.3% | 1 | 6.3% | ||
| 1250 | 268 | 20.9% | 3.81 | |||
Make the Cut Rate Rankings
1) Crab – 30%
2) Lion – 26%
3) Phoenix – 26%
4) Dragon – 23%
5) Mantis – 21%
AVERAGE – 21%
6) Scorpion – 19%
7) Unicorn 17%
8 ) Spider – 15%
9) Crane – 11%
I think when people say an environment is ‘balanced’ they don’t mean that all factions are competitive, but rather that no one faction is exceptionally good. I like the analysis though, and will definitely read over it again when it’s not the morning.
Good analysis. The only thing I’d add to your explanation is why the overall number (3.81) shows we’re ‘balanced’ (it’s less than 3.94) even though two individual factions show up as unbalanced. The explanation is that ‘balanced’ means ‘would happen by chance 1 time in 20’ and we have 9 data points, so it’s not unreasonable that the 1 in 20 chance would pop up once or twice.
Crane and Spider still getting whooped.
But now we know that the Crane are getting statistically significantly whooped, and the Spider are not yet. 😀
Will take initiative to help you guys out with, lets say “unofficial” info:
Player participation in Greek Kotei
Crab 12
Crane 7
Dragon 4
Lion 11
Mantis 7
Phoenix 7
Scorpion 12
Spider 7
Unicorn 3
Phoenix won against Unicorn
Top 4 Phoenix-Unicorn-Crab/Scorpion
PS Not entirely sure of participants and their clan but result is certain
The difference, I believe, between Crane and Spider is that Crane’s decks are just underpowered right now.
Spider has two decent to good decks right now (and that dark horse Shadow’s Lair deck from last weekend that’s created some buzz), but the bad matchup of at least one of those decks (Monksai) is everywhere. I’m also not sure how well Paragons does against it either, but I’m also less familiar with Paragons right now, having lived and breathed Monksai for several weeks now.
Stupid Kyuden Hida xp.
Interesting how Lions are making the cut, but not then cutting the mustard (so to speak)… Compare and Contrast to Scorpion for example. Any Strange Assembly Speculation on these two reverse trends? If it’s kitsu honor making the cuts mostly, is it too weak vs. post-cut military decks? Conversely, given the 2 kotei wins, why aren’t more Scorpions making the cut? Just how much are these trends a product of the kotei-attending player base? A linked question might therefore be: How much bandwagoning have we seen? Can we get equivalent clan percentages from last year so that we can consider cross-clan migration (expecting Crane exodus, Crab influx)?
Hard to say on wins v. decks in cut, as the data points start getting small. Also, at least for now there are 3 events that we have a winner for, but no equivalent data. Plus the whole not actually knowing that made the cut for most of these decks. For example, Kitsu Honor has had a couple of high finishes for Lion, but does that mean a lot of the Lion making the cut aren’t Paragons?
Yeah, I do have the requested data (well, mostly). I even have it back from Samurai, although for reasons I won’t go into it would be a pain to get that particular figure for in SE.
In Celestial Edition as a whole, all of the Clans other than Unicorn and Mantis are between 11% and 12% (Unicorn and Mantis were below 10%). A year ago would have been the Dead of Winter environment. The attendance and “make the cut” rates were:
Make Cut Rate – Clan – % of Field
20.3% – Lion – 10.5%
17.4% – Crab – 11.1%
16.5% – Spider – 12.5%
15.8% – Crane – 13.0%
15.0% – Mantis – 9.0%
13.8% – Unicorn – 9.1%
12.0% – Dragon – 9.9%
11.6% – Scorpion – 13.1%
11.5% – Phoenix – 10.0%
FYI, the current attendance figures for Crab are enormous. We have not had any Clan with that high a figure over an entire environment for years, regardless of how good the Clan was (of course, this environment isn’t over, but still).
It could be, as I think we commented, all 4 of the crab boxes are fully operational at the get-go (and are absolutely amazing boxes). That said, I did it for the money.