|
![[image loading]](http://s23.postimg.org/wf44ixxi3/Balance.png)
Protoss is pretty much in free fall, especially in PvZ (haven't had a win rate that imbalanced for three years, and PvZ is more imbalanced than ever), and yet nerfs are planned for Pylon Overcharge and the Adept... interesting.
http://aligulac.com/misc/balance/
|
Thanks, love your stats! 
Can we get some information about sample size and/or error bars or something please? These numbers are close to worthless without an idea of how large the uncertainty is.
Maybe you can vertical make a line for lotv as well, as you have for hots?
Interesting to see how PvT dropped a lot first month after hots, then immediately recovered for month 2, while TvZ had a 3-4 month advantage.
|
These aren't my stats. Click the link and you'll get all the information regarding sample size and such. The December stats are based on 2683 games.
|
On January 02 2016 17:08 BronzeKnee wrote: These aren't my stats. Click the link and you'll get all the information regarding sample size and such. The December stats are based on 2683 games. Yeah, I had a quick look, and wasn't very accessible. I'd like to have the information on the plot, to better understand what is random fluctuations, and what isn't. Hopefully the people making the plot will read this. Shouldn't be hard to add.
Thanks though! 2683 seems like a lot.
|
Message em here: http://www.teamliquid.net/forum/starcraft-2/404035-aligulaccom-changelog-and-feedback-thread
I don't think there is random fluctuations with balance. There is map changes, patches, meta swings, ect that affect balance. With such a large sample size, it would be impossible to tell a random fluctuation from a meta swing.
The second chart is something I pushed for a long time ago, and really tells the story for me. It predicts performance based on past results, and then compares the prediction to real performance. This helps control for players who go on big hot streaks and are very dominant in a single matchup from skewing the data. We continue to see Protoss underperform on that chart.
|
When Aligulac begins to count maps in balance? The main problem of today's balance is imbalanced map pool
|
More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player
|
On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player
those numbers are based on pro games, not ladder games.
|
On January 02 2016 18:11 dNa wrote:Show nested quote +On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player those numbers are based on pro games, not ladder games.
So its nothing to do with Balance.I watched the majority of GSL qualifiers, where a lot of the top players struggled with the new meta and made massive mistakes loosing them the games. The map pool was one of the biggest deciders for the results
"Note that this yields information about metagame balance near the top of the skill ladder, and is not to be confused with (although likely correlated to) actual game balance throughout the whole player population."
|
On January 02 2016 17:56 Areanon wrote: When Aligulac begins to count maps in balance? The main problem of today's balance is imbalanced map pool
This has been addressed before. The answer is probably never. While I don't disagree with your assessment, bear in mind Aligulac is not intended as a tool of checking and monitoring game balance, although you may use it as such.
On July 11 2013 06:39 Grovbolle wrote: While I won't discuss the statistical/predictional value on the matter of maps or no maps, I can discuss some of the more simple issues: 1: Getting the info on maps played can be tough unless you are talking about the big leagues, let's not get into the problems with different versions of a map and some with forced spawns etc. 2: Backtracking the existing DB would take months since we can't do it in bulks like we did with the event NSM. 3: Number of capable volunteers = 5-10 4: The entire entry system/parsing system would need an overhaul. 5: As far as I recall, we store the rows of matches as sets, not games, meaning that they would needed to be split with an extra attribute to keep track of which games belongs to which set.
I really wish we could have maps, but if you check aligulac.com/db you see that outside kiekaboe, conti, BB, MoP and shellshock, we really doesn't have nearly enough manpower to consistently keep it all updated, nor do we have the prestige of being affilliated with TL to attract them.
|
On January 02 2016 18:23 Topdoller wrote:Show nested quote +On January 02 2016 18:11 dNa wrote:On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player those numbers are based on pro games, not ladder games. So its nothing to do with Balance.I watched the majority of GSL qualifiers, where a lot of the top players struggled with the new meta and made massive mistakes loosing them the games. The map pool was one of the biggest deciders for the results "Note that this yields information about metagame balance near the top of the skill ladder, and is not to be confused with (although likely correlated to) actual game balance throughout the whole player population." The stats mean nothing? Really? This is the best information we have on balance... It's showing exactly what it says: tosses tend to lose against zergs lately. That is very important information imo, I don't understand how you can argue otherwise. People put all kinds of meaning into the word "balance", so maybe would've been better to not use that word in the OP, but it seems like your issue is deeper than that? Anyway, almost all definitions of the word "balance" will be correlated with the win-rates in the OP. They are not interchangeable (partially because people don't agree on what "balance" actually means), but "nothing to do with balance" just isn't accurate.
Is it just a phase of the meta, and will straighten out in a month? Should we change map pool? Do we need to change the units? These stats can't tell, and I don't think anyone can tell. But it does provide as much information as we can get to speculate further, and I think that what we see here is reason to start thinking about changes to either the map pool or units.
|
On January 02 2016 18:23 Topdoller wrote:Show nested quote +On January 02 2016 18:11 dNa wrote:On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player those numbers are based on pro games, not ladder games. So its nothing to do with Balance.I watched the majority of GSL qualifiers, where a lot of the top players struggled with the new meta and made massive mistakes loosing them the games. The map pool was one of the biggest deciders for the results "Note that this yields information about metagame balance near the top of the skill ladder, and is not to be confused with (although likely correlated to) actual game balance throughout the whole player population."
I agree with this, the map pool is absolute shit which always ends up screwing one race over for the season.
I do believe that Protoss is in a bit of a learning curve right now at the top level vs. Zerg but nothing really looks particularly imbalanced, I saw plenty of Protoss having total micro fails and losing Disruptors for no good reason in important engagements or not even bothering to utilize the Warp Prism at all.
I think a few tweaks here and there might be okay but we should aim for better map pool and another month or two of pro level games before the bigger buffs/nerfs start to get tossed around.
|
Australia18228 Posts
On January 02 2016 17:11 Cascade wrote:Show nested quote +On January 02 2016 17:08 BronzeKnee wrote: These aren't my stats. Click the link and you'll get all the information regarding sample size and such. The December stats are based on 2683 games. Yeah, I had a quick look, and wasn't very accessible. I'd like to have the information on the plot, to better understand what is random fluctuations, and what isn't. Hopefully the people making the plot will read this. Shouldn't be hard to add. Thanks though! 2683 seems like a lot.
It's there if you hover over the dots 987 TvZ 635 PvT 1061 PvZ
|
Please stop using winrates as an equivalent for balance. Balance means equal possibility to win given equal skill level.
|
|
On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player
Strong post First attacks poster that he has agenda when "Balance report" is name of this graph. Then discredits results because of matchmaking system when report is based on tournaments games.
|
On January 02 2016 19:06 Inflicted wrote:Show nested quote +On January 02 2016 17:11 Cascade wrote:On January 02 2016 17:08 BronzeKnee wrote: These aren't my stats. Click the link and you'll get all the information regarding sample size and such. The December stats are based on 2683 games. Yeah, I had a quick look, and wasn't very accessible. I'd like to have the information on the plot, to better understand what is random fluctuations, and what isn't. Hopefully the people making the plot will read this. Shouldn't be hard to add. Thanks though! 2683 seems like a lot. It's there if you hover over the dots 987 TvZ 635 PvT 1061 PvZ Oh, I missed that! How embarrassing, especially as I am coding interactive plots right now... :o
Thanks!
|
On January 02 2016 19:06 zerge wrote: Please stop using winrates as an equivalent for balance. Balance means equal possibility to win given equal skill level.
We don't have tools to measure skill level.
|
I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it. 
anyway, thanks for keeping it up aligulac ppl!
|
PvT - pretty good TvZ - pretty good PvZ - uhhhhh
|
Aotearoa39261 Posts
This is cool, thanks for posting.
|
On January 02 2016 17:56 Areanon wrote: When Aligulac begins to count maps in balance? The main problem of today's balance is imbalanced map pool I prefer imbalanced mappool than imbalanced race-strenghts. I hope Blizz stops soon with race and only focus on maps with slightly favored for each race.
Another thing I see the problem with those stats. They dont show if games were good. For me, the quality of the games have been worse form patch to patch (WoL and HotS). If they show 50-50, okay it looks balanced but did we see good matches?
|
This is somewhat disingenuous by Bronzeknee as such stats have been discussed in the designated dalance discussion thread already and been found wanting. Bronzeknee was part of these discussions so he should know better.
That's not to say that there isn't an early indication of a problem in PvZ.
Let's look at the actual data:
26.11-09.12
![[image loading]](http://i.imgur.com/OzI9niy.png)
10.12-23.12
![[image loading]](http://i.imgur.com/iYkwQhA.png)
24.12-02.01
![[image loading]](http://i.imgur.com/RtswPRZ.png)
While it looks all impressive that the periods have 2060, 2124 and 438 games played, together 4622 games, if you look at a MU, there are very few games indeed. PvZ is at only 550-731, together 1281 games and the winrate is 43%. This indicates an issue, but I wouldn't jump to conclusions yet.
It's useful to ask how representative the sample size is, i.e., how many people would need to have a bad day to change the result by a percentage point. The answer is 4. If 4 Z players during the month had a bad day, for example a hangover during their game, and they lost 2-0 instead of winning 2-0, the result would be 44%. That's a scary low number.
That basically says that the balance from acceptable short-term winrate of 45% is 8 people, and for perfect balance 45 matches should have gone differently.
One should also look at the number of mirrors, btw, as that indicates how many representatives of a race do well at tournaments (although population sizes for the race play a role). It's noteworthy that P has the fewest mirrors currently, while historically T has had fewer by a significant margin. This also indicates a possible problem for P.
In conclusion, we can keep an eye on balance over the following months, but I wouldn't jump to any firm conclusions before we see how the winrates fluctuate over the coming months. Hopefully there will be more games. The other MUs look to be statistically well balanced based on the stats.
Of course, Aligulac lists are not the only source of data. We should also compare this with other sources such as premium tournament data, but there the sample size is still so very low that I cannot find it in me to do the work at the moment.
|
kinda reflects the one trick protoss a little. They are stronger before people figure out what units hold which all in - but then, their winrates suffer from beeing cost inefficient / easy to pull apart in the lategame.
Then blizzard comes, does some significant change - and were back to balance whines about protoss.
|
On January 02 2016 20:26 Ghanburighan wrote: It's useful to ask how representative the sample size is, i.e., how many people would need to have a bad day to change the result by a percentage point. The answer is 4. If 4 Z players during the month had a bad day, for example a hangover during their game, and they lost 2-0 instead of winning 2-0, the result would be 44%. That's a scary low number.
That basically says that the balance from acceptable short-term winrate of 45% is 8 people, and for perfect balance 45 matches should have gone differently.
Having to change 8 bo3s that zerg won 2-0 to a 2-0 win for toss to move it only from 43% to 45% sounds like a pretty strong signal to me.
Doing p-values, 45% winrate has a 7% p-value (single sided binomial, assuming maps independent), 46% is below the "magic" 5%, and 50% is super low.
This is maps though, and the maps in a bo3 are correlated, so reducing effective sample size from 1281 to 500 (a bit more than a factor 2, which is about the number of games in a bo3), the 5% significance hits between 46% and 47% instead. 45% winrate gets a 17% p-value.
The above is only a back-of-the-envelope calculation of course, but I think we need to acknowledge that there is a significant probability that the true ZvP winrate is below 45%.
|
On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player
People have no idea what balance means ;-)
It means that every race has the same chance to win which means winrate is 50%. How else would you measure balance? These stats are really nice.
|
Does the stats account for ELO rankings as well, or is this just a flat average winrate?
Let's say there was a lot of uneven matches skill-wise, e.g. a few Zergs had some easy opponents through a couple of tournaments, while the rest were more or less evenly matched. Then Zerg would generate a high winrate, though they were favored to win because of their superior skill level. Weighting by the ELO ranking would even out such discrepancies.
Or maybe it would cancel out any meaningful winrate stats in total, in that one would statistically expect a 50% winrate for all matchups. I'm not sure.
|
On January 02 2016 21:32 cheekymonkey wrote: Does the stats account for ELO rankings as well, or is this just a flat average winrate?
Let's say there was a lot of uneven matches skill-wise, e.g. a few Zergs had some easy opponents through a couple of tournaments, while the rest were more or less evenly matched. Then Zerg would generate a high winrate, despite the fact they were favored to win because of their superior skill level. Weighting by the ELO ranking would even out such discrepancies. just flat average. Which tbh doesnt mean anything
|
Australia18228 Posts
On January 02 2016 21:32 cheekymonkey wrote: Does the stats account for ELO rankings as well, or is this just a flat average winrate?
Let's say there was a lot of uneven matches skill-wise, e.g. a few Zergs had some easy opponents through a couple of tournaments, while the rest were more or less evenly matched. Then Zerg would generate a high winrate, though they were favored to win because of their superior skill level. Weighting by the ELO ranking would even out such discrepancies.
Or maybe it would cancel out any meaningful winrate stats in total, in that one would statistically expect a 50% winrate for all matchups. I'm not sure.
The database is available, maybe someone can filter for XX points difference
|
Where can you get the data-set of this win rate graph from by the OP. I am curious to see the players and tournaments involved in these results that were used to generate this?
I have checked out the web site and no data-set is included, just graphs and how to download said graph in a particular format such as a PDF
|
On January 02 2016 19:22 Cascade wrote:I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it.  anyway, thanks for keeping it up aligulac ppl!  I always thought it was more like this:
Thread gives a reason to whine about Protoss? Awesome great work, Aligulac shows us how the balance currently is.
Thread doesn't give us a reason to whine about Protoss? Meh, but the graphs look really nice and game design guys!
Thread shows Protoss looses a bunch more than winning? Why the fuck are you even posting it here you biased little c***?!
Tho that might be my biased view on it that is heavily tarnished by reddits reaction to these threads =P
|
On January 02 2016 22:46 Arvendilin wrote:Show nested quote +On January 02 2016 19:22 Cascade wrote:I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it.  anyway, thanks for keeping it up aligulac ppl!  I always thought it was more like this: Thread gives a reason to whine about Protoss? Awesome great work, Aligulac shows us how the balance currently is. Thread doesn't give us a reason to whine about Protoss? Meh, but the graphs look really nice and game design guys! Thread shows Protoss looses a bunch more than winning? Why the fuck are you even posting it here you biased little c***?! Tho that might be my biased view on it that is heavily tarnished by reddits reaction to these threads =P I think you are right. When was the winrate for any of the 3 races this low in one MU? 40% in PvZ points to quite a huge imbalance, yet people keep suggesting how top Protoss players need to adjust and learn to play. If it was Zerg having a 40% in ZvP, TeamLiquid's server would crash due to excessive whining. 
But no matter, I look forward to the Protoss nerfs and the winrate dropping below 40% in PvZ.
|
Aside from the P winrate, which has been kind of acknowledged anyway in that the balance test map offers a lot/maybe too much zerg nerfs, what's jumping at me from this is that we're now offering two nerfs for PvT when neither the numbers (48%) nor the trend of the match-up (T improving consistently each month so far) appear to warrant it. I get that adept all-ins are frustrating to deal with, and they may even be too strong, I don't know. But two nerfs for a match-up where the nerfed race is declining and already under 50% makes me worry a bit. I wonder if we're not in the equivalent process of nerfing terran speedivacs at the start of HotS.
|
On January 02 2016 22:46 Arvendilin wrote:Show nested quote +On January 02 2016 19:22 Cascade wrote:I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it.  anyway, thanks for keeping it up aligulac ppl!  I always thought it was more like this: Thread gives a reason to whine about Protoss? Awesome great work, Aligulac shows us how the balance currently is. Thread doesn't give us a reason to whine about Protoss? Meh, but the graphs look really nice and game design guys! Thread shows Protoss looses a bunch more than winning? Why the fuck are you even posting it here you biased little c***?! Tho that might be my biased view on it that is heavily tarnished by reddits reaction to these threads =P Sounds like bias to me at first glance, but then again I main zerg, so I guess it's not for me to say. I'd be happy with zerg nerfs for the record, and you've seen me argue that the signal is real and important in this thread. Those balance tweaks don't really matter at gold anyway, compared to having proper mechanics.... A nerf maybe will push me from gold rank 40 to gold rank 55, but who the fuck cares.
Anyway, I was also thinking of race-independent OPs, like all the story with the economy, the macro mechanics and so on.
|
The game is balanced for the top of the practical skill ceiling - is it possible a filter could be applied to exclude all non-Korean matches not in the GSL or SSL? Thanks.
|
On January 03 2016 01:15 EatingBomber wrote: The game is balanced for the top of the practical skill ceiling - is it possible a filter could be applied to exclude all non-Korean matches not in the GSL or SSL? Thanks. Sure. Here are the stats for GSL 2016 and SSL 2016.
|
On January 02 2016 23:47 CheddarToss wrote:Show nested quote +On January 02 2016 22:46 Arvendilin wrote:On January 02 2016 19:22 Cascade wrote:I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it.  anyway, thanks for keeping it up aligulac ppl!  I always thought it was more like this: Thread gives a reason to whine about Protoss? Awesome great work, Aligulac shows us how the balance currently is. Thread doesn't give us a reason to whine about Protoss? Meh, but the graphs look really nice and game design guys! Thread shows Protoss looses a bunch more than winning? Why the fuck are you even posting it here you biased little c***?! Tho that might be my biased view on it that is heavily tarnished by reddits reaction to these threads =P I think you are right. When was the winrate for any of the 3 races this low in one MU? 40% in PvZ points to quite a huge imbalance, yet people keep suggesting how top Protoss players need to adjust and learn to play. If it was Zerg having a 40% in ZvP, TeamLiquid's server would crash due to excessive whining.  But no matter, I look forward to the Protoss nerfs and the winrate dropping below 40% in PvZ. Every races but mine whines the most my race makes valid complaints. The reason people don't take this stats seriously is because they don't really show us anything Note how zerg is by far the highest between JAN 2014 and july 2014 that was the blink era where protoss won 9 tournaments in a row and half of them had pvp finals. On the otherhand broodlord infestor had around 50% zvp winrate
|
I agree that calling it a 'balance' report is misleading and implies that the statistics shown are solely a result of balance and no other factors, which is ignorant to assume.
LOTV is a new expansion and people are still figuring it out. The statistics you provided do show that Protoss players aren't doing well in PvZ at the moment, and one possible cause may be balance, but it is ignorant to assume that it is the only reason for them performing poorly.
Maybe part of the reason is that many Protoss players on ladder just deathballed for 5 years and now that style is no longer viable. I don't mean to imply that the players who played this way aren't skilled because I know many of them are, it was just the way Protoss had to play for a while.
But maybe the changes made for LOTV are causing Protoss players to relearn the matchup to an extent. Part of this is that the ravager has given Zerg some early/mid game timings that are being abused a lot on ladder right now. Blizzard has acknowledged that they think these timing attacks are too strong and plan to address it in the next patch by increasing the ravager morph time.
So my point is yes there may be some balance issues and yes these statistics may reflect that, however, it is naive to assume that balance is the ONLY factor driving those statistics because there are many other factors at play.
|
On January 03 2016 01:22 StateSC2 wrote:Show nested quote +On January 03 2016 01:15 EatingBomber wrote: The game is balanced for the top of the practical skill ceiling - is it possible a filter could be applied to exclude all non-Korean matches not in the GSL or SSL? Thanks. Sure. Here are the stats for GSL 2016 and SSL 2016.
Ah, thank you so much.
BTW, aren't you that American player who travelled to South Korea to train?
|
On January 03 2016 02:16 EatingBomber wrote:Show nested quote +On January 03 2016 01:22 StateSC2 wrote:On January 03 2016 01:15 EatingBomber wrote: The game is balanced for the top of the practical skill ceiling - is it possible a filter could be applied to exclude all non-Korean matches not in the GSL or SSL? Thanks. Sure. Here are the stats for GSL 2016 and SSL 2016. Ah, thank you so much. BTW, aren't you that American player who travelled to South Korea to train? He even still lives in Korea.
|
I don't know if this applies to today's case but it's funny how: - when Protoss is weak -> this is the map pool's fault - when Protoss in strong -> obviously the race is broken and we need to nerf the units
It would be nice if people were a little more open-minded about the fact that regardless of race played there is someone struggling with a mouse and a keyboard on the other side too. These numbers don't show what the issue is and how to solve it, so reciprocally please don't discard every possibility including that it may not only due to map pool. It would be very sad if we had to absolutely always have the same boring standard maps to have something close to balance.
|
On January 03 2016 02:13 ApBuLLet wrote: I agree that calling it a 'balance' report is misleading and implies that the statistics shown are solely a result of balance and no other factors, which is ignorant to assume.
LOTV is a new expansion and people are still figuring it out. The statistics you provided do show that Protoss players aren't doing well in PvZ at the moment, and one possible cause may be balance, but it is ignorant to assume that it is the only reason for them performing poorly.
Maybe part of the reason is that many Protoss players on ladder just deathballed for 5 years and now that style is no longer viable. I don't mean to imply that the players who played this way aren't skilled because I know many of them are, it was just the way Protoss had to play for a while.
But maybe the changes made for LOTV are causing Protoss players to relearn the matchup to an extent. Part of this is that the ravager has given Zerg some early/mid game timings that are being abused a lot on ladder right now. Blizzard has acknowledged that they think these timing attacks are too strong and plan to address it in the next patch by increasing the ravager morph time.
So my point is yes there may be some balance issues and yes these statistics may reflect that, however, it is naive to assume that balance is the ONLY factor driving those statistics because there are many other factors at play.
On January 02 2016 18:11 dNa wrote:Show nested quote +On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player those numbers are based on pro games, not ladder games.
These stats are not from the ladder.
|
On January 03 2016 01:22 StateSC2 wrote:Show nested quote +On January 03 2016 01:15 EatingBomber wrote: The game is balanced for the top of the practical skill ceiling - is it possible a filter could be applied to exclude all non-Korean matches not in the GSL or SSL? Thanks. Sure. Here are the stats for GSL 2016 and SSL 2016. Nice.
A lot of names I don't recognize in the GSL stats (did they do open qualifiers or something? ) and almost no games between top players in the recent matches which I find odd. Could be skewing data but it definitely seems to indicate a big advantage in favor of Z in PvZ, slight advantage for Z in TvZ and about equal TvP.
SSL stats are interesting, less unknowns but still quite a few, a lot of unknown T losing to known P might be skewing that data set. Also not a whole lot of data on the TvZ set which seems so skewed. Protoss seems to have a slight advantage PvZ according to this data though.
Also nice to see you still playing in Korea State!
|
On January 03 2016 02:19 dae wrote:Show nested quote +On January 03 2016 02:13 ApBuLLet wrote: I agree that calling it a 'balance' report is misleading and implies that the statistics shown are solely a result of balance and no other factors, which is ignorant to assume.
LOTV is a new expansion and people are still figuring it out. The statistics you provided do show that Protoss players aren't doing well in PvZ at the moment, and one possible cause may be balance, but it is ignorant to assume that it is the only reason for them performing poorly.
Maybe part of the reason is that many Protoss players on ladder just deathballed for 5 years and now that style is no longer viable. I don't mean to imply that the players who played this way aren't skilled because I know many of them are, it was just the way Protoss had to play for a while.
But maybe the changes made for LOTV are causing Protoss players to relearn the matchup to an extent. Part of this is that the ravager has given Zerg some early/mid game timings that are being abused a lot on ladder right now. Blizzard has acknowledged that they think these timing attacks are too strong and plan to address it in the next patch by increasing the ravager morph time.
So my point is yes there may be some balance issues and yes these statistics may reflect that, however, it is naive to assume that balance is the ONLY factor driving those statistics because there are many other factors at play. Show nested quote +On January 02 2016 18:11 dNa wrote:On January 02 2016 18:04 Topdoller wrote: More stats which mean nothing, when you consider the maps currently in use.
Also the word "Balance" is misleading in the title of the OP. Shouldn't it say "Win Rate" or something or are you trying to promote your agenda here?
Aligulac is nothing to do with balance, it never has and it never will, especially when the matchmaking system is designed to match player v player those numbers are based on pro games, not ladder games. These stats are not from the ladder.
My bad, didn't realize that they were stats from pro games. I assumed it was ladder because the OP talks about 'performance rating' which I assumed was something to do with the ladder, such as MMR. Now I see that it is referring to the rating from aligulac.
That changes things slightly but I think my general point that there are more factors in play is still valid.
|
On January 03 2016 01:38 HellHound wrote:Show nested quote +On January 02 2016 23:47 CheddarToss wrote:On January 02 2016 22:46 Arvendilin wrote:On January 02 2016 19:22 Cascade wrote:I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it.  anyway, thanks for keeping it up aligulac ppl!  I always thought it was more like this: Thread gives a reason to whine about Protoss? Awesome great work, Aligulac shows us how the balance currently is. Thread doesn't give us a reason to whine about Protoss? Meh, but the graphs look really nice and game design guys! Thread shows Protoss looses a bunch more than winning? Why the fuck are you even posting it here you biased little c***?! Tho that might be my biased view on it that is heavily tarnished by reddits reaction to these threads =P I think you are right. When was the winrate for any of the 3 races this low in one MU? 40% in PvZ points to quite a huge imbalance, yet people keep suggesting how top Protoss players need to adjust and learn to play. If it was Zerg having a 40% in ZvP, TeamLiquid's server would crash due to excessive whining.  But no matter, I look forward to the Protoss nerfs and the winrate dropping below 40% in PvZ. Every races but mine whines the most my race makes valid complaints. The reason people don't take this stats seriously is because they don't really show us anything Note how zerg is by far the highest between JAN 2014 and july 2014 that was the blink era where protoss won 9 tournaments in a row and half of them had pvp finals. On the otherhand broodlord infestor had around 50% zvp winrate
By your logic of counting tournamets wins during broodlor infestor era (May 2012 till end of WoL) toournametnts wins: Premier: Z:15, P:13 Major: Z:13, P:15 So PvZ close to 50% is not that suprising. Terran struggled in tournaments wins and TvZ winrates.
As for 2014 Zerg was dominating major tournaments ,Between march and july(in these months aligulac shows Zerg as strongest race) Zerg won 10/17 events and had 18/34 finalists)
|
Prion Terraces and Central Protocol definitely need to go. They heavily impact PvZ balance.
On prion Terraces 3 hatch with 2 gold base is just too strong for Protoss to deal with and on Central Protocol the choke points are too big to defend.
It is not an issue zerg has to face as they have aquired the ability to deal with not having wall-ins and choke points over the years and good macro management is required as a zerg to have, but as a Protoss and Terran those wide open areas do not allow them to greedily tech and macro behind a small choke point with tanks/bunkers or Pylon Overcharge.
One very big thing though.
Since it is the beginning of LOTV I feel that Terrans and Protoss are very bad at defending and scouting. 80 % of my wins against P or T come from Roach/Ravager or Ling/Baneling All-Ins that they could easily defend if they scouted it, but instead they always do the same thing :
Build Reaper/Adept to harass and then macro/tech up and win lategame with a strong push right before Ultralisk spawn.
With new maps and P/T learning to be more dynamic towards scouting, map awareness and strategy reading I think the numbers will be different from what we see now.
|
On January 03 2016 02:17 Elentos wrote:Show nested quote +On January 03 2016 02:16 EatingBomber wrote:On January 03 2016 01:22 StateSC2 wrote:On January 03 2016 01:15 EatingBomber wrote: The game is balanced for the top of the practical skill ceiling - is it possible a filter could be applied to exclude all non-Korean matches not in the GSL or SSL? Thanks. Sure. Here are the stats for GSL 2016 and SSL 2016. Ah, thank you so much. BTW, aren't you that American player who travelled to South Korea to train? He even still lives in Korea.
Ah, capital. I hope you achieve your aims successfully in Korea. It must be difficult going overseas to train for this game.
|
How on earth TvP is terran favored? very wow
|
On January 03 2016 01:38 HellHound wrote:Show nested quote +On January 02 2016 23:47 CheddarToss wrote:On January 02 2016 22:46 Arvendilin wrote:On January 02 2016 19:22 Cascade wrote:I am increasingly realising that the reception of these threads is 99% depending on presentation, not quality or relevance of the analysis. Not 80% as I previously thought. Next month, better write up a smooth presentation with 50 paragraphs of nonsense organised in chapters with random images, and everyone will love it.  anyway, thanks for keeping it up aligulac ppl!  I always thought it was more like this: Thread gives a reason to whine about Protoss? Awesome great work, Aligulac shows us how the balance currently is. Thread doesn't give us a reason to whine about Protoss? Meh, but the graphs look really nice and game design guys! Thread shows Protoss looses a bunch more than winning? Why the fuck are you even posting it here you biased little c***?! Tho that might be my biased view on it that is heavily tarnished by reddits reaction to these threads =P I think you are right. When was the winrate for any of the 3 races this low in one MU? 40% in PvZ points to quite a huge imbalance, yet people keep suggesting how top Protoss players need to adjust and learn to play. If it was Zerg having a 40% in ZvP, TeamLiquid's server would crash due to excessive whining.  But no matter, I look forward to the Protoss nerfs and the winrate dropping below 40% in PvZ. Every races but mine whines the most my race makes valid complaints. The reason people don't take this stats seriously is because they don't really show us anything Note how zerg is by far the highest between JAN 2014 and july 2014 that was the blink era where protoss won 9 tournaments in a row and half of them had pvp finals. On the otherhand broodlord infestor had around 50% zvp winrate
Actually the movements in the balance line from Aligulac mirror the movements of balance pretty well, I'm not sure what you're talking about. PvT early 2014 is the high line until it gets patched, TvZ is the low line in broodlord infestor, and in both situations the other match-up is less influenced (because it was less influenced, and even then PvZ is not really at 50%...). All of the notable periods of imbalance are represented on the line. The ones that aren't were design issues (like the notion that protoss is forced to all-in before BL infest in 2012: it sucked, but they did have a good chance of winning when they did all in, so of course the balance line won't reflect anything relevant for PvZ there) or were problems that happened mostly in your imagination.
|
This at least reflects my ladder experience. You can really feel that the Zergs you meet are just weaker players, as you win all the mindgames, all the small micro skirmishes, but the race make them feel like playing a GM player, as they just have way more.
I mean it makes sense when you look at what happened since HotS and all the changes, Protoss was mostly nerfed and Zerg have received a ton of small buffs. Maps aren't that great either.
|
If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information.
|
On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information.
Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered.
But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change.
On January 02 2016 19:15 keglu wrote:Show nested quote +On January 02 2016 19:06 zerge wrote: Please stop using winrates as an equivalent for balance. Balance means equal possibility to win given equal skill level.
We don't have tools to measure skill level.
But we do! That is what the performance difference chart is for.
|
On January 03 2016 02:18 PPN wrote: I don't know if this applies to today's case but it's funny how: - when Protoss is weak -> this is the map pool's fault - when Protoss in strong -> obviously the race is broken and we need to nerf the units
It would be nice if people were a little more open-minded about the fact that regardless of race played there is someone struggling with a mouse and a keyboard on the other side too. These numbers don't show what the issue is and how to solve it, so reciprocally please don't discard every possibility including that it may not only due to map pool. It would be very sad if we had to absolutely always have the same boring standard maps to have something close to balance.
The blink era was entirely the fault of awful maps and everybody knew that and thats how it was resolved, I have no idea what you are talking about
|
On January 03 2016 03:49 Lexender wrote:Show nested quote +On January 03 2016 02:18 PPN wrote: I don't know if this applies to today's case but it's funny how: - when Protoss is weak -> this is the map pool's fault - when Protoss in strong -> obviously the race is broken and we need to nerf the units
It would be nice if people were a little more open-minded about the fact that regardless of race played there is someone struggling with a mouse and a keyboard on the other side too. These numbers don't show what the issue is and how to solve it, so reciprocally please don't discard every possibility including that it may not only due to map pool. It would be very sad if we had to absolutely always have the same boring standard maps to have something close to balance. The blink era was entirely the fault of awful maps and everybody knew that and thats how it was resolved, I have no idea what you are talking about
Uck. While you could blame the maps, I blame the game design. What solved the 1-1-1? Map design. What solve the Roach max build versus Protoss? Map design. And you can add so many more builds to that list.
There is an incredible number of restrictions on map design these days because Blizzard fails to solve the problems with game design.
|
On January 03 2016 03:49 Lexender wrote:Show nested quote +On January 03 2016 02:18 PPN wrote: I don't know if this applies to today's case but it's funny how: - when Protoss is weak -> this is the map pool's fault - when Protoss in strong -> obviously the race is broken and we need to nerf the units
It would be nice if people were a little more open-minded about the fact that regardless of race played there is someone struggling with a mouse and a keyboard on the other side too. These numbers don't show what the issue is and how to solve it, so reciprocally please don't discard every possibility including that it may not only due to map pool. It would be very sad if we had to absolutely always have the same boring standard maps to have something close to balance. The blink era was entirely the fault of awful maps and everybody knew that and thats how it was resolved, I have no idea what you are talking about You mean like the Blink nerf?
I think MsC vision was also at that time, not sure.
|
Maps are Zerg favored yes but only changing maps won't be enough. I even think problem is much deeper than just balance, zerg is way too easy to play in lotv. Terran and Protoss is way harder to play than zerg league distribution shows it pretty well imo. Protoss needs late game buffs, they can nerf adepts but if they do it without buffing late game units first protoss will have no ways to win left.
|
On January 03 2016 03:52 ejozl wrote:Show nested quote +On January 03 2016 03:49 Lexender wrote:On January 03 2016 02:18 PPN wrote: I don't know if this applies to today's case but it's funny how: - when Protoss is weak -> this is the map pool's fault - when Protoss in strong -> obviously the race is broken and we need to nerf the units
It would be nice if people were a little more open-minded about the fact that regardless of race played there is someone struggling with a mouse and a keyboard on the other side too. These numbers don't show what the issue is and how to solve it, so reciprocally please don't discard every possibility including that it may not only due to map pool. It would be very sad if we had to absolutely always have the same boring standard maps to have something close to balance. The blink era was entirely the fault of awful maps and everybody knew that and thats how it was resolved, I have no idea what you are talking about You mean like the Blink nerf? I think MsC vision was also at that time, not sure.
They didn't nerf blink during the blink era, they did nerf MsC vision tho, but its not like they nerfed blink it self directly, even without the MsC nerf the maps where what was needed.
|
On January 03 2016 03:48 BronzeKnee wrote:Show nested quote +On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result.
|
On January 03 2016 04:48 TheWinks wrote:Show nested quote +On January 03 2016 03:48 BronzeKnee wrote:On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result.
I remember when ByuN was being number 1 terran, in the middle of HotS
|
On January 03 2016 04:54 Lexender wrote:Show nested quote +On January 03 2016 04:48 TheWinks wrote:On January 03 2016 03:48 BronzeKnee wrote:On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result. I remember when ByuN was being number 1 terran, in the middle of HotS
We know how it works. When people play a lot of online tournaments, they end up advancing their rating way more (and way easier) than the people who play only GSL and the occasional week-end tournament, even though they are playing weaker opposition. You have demonstrated that the ranking is flawed, but that's completely different from collecting results and calculating a win percentage based on them.
What is described as "garbage" is simply things that contradict the narrative you're pulling for.
|
On January 03 2016 06:54 Nebuchad wrote:Show nested quote +On January 03 2016 04:54 Lexender wrote:On January 03 2016 04:48 TheWinks wrote:On January 03 2016 03:48 BronzeKnee wrote:On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result. I remember when ByuN was being number 1 terran, in the middle of HotS We know how it works. When people play a lot of online tournaments, they end up advancing their rating way more (and way easier) than the people who play only GSL and the occasional week-end tournament, even though they are playing weaker opposition. You have demonstrated that the ranking is flawed, but that's completely different from collecting results and calculating a win percentage based on them. What is described as "garbage" is simply things that contradict the narrative you're pulling for. The two things you're describing are linked. If a top or near top level Korean goes into an online tournament and wipes the floor with a bunch of foreigners he gets a bigger boost in aligulac rating that he really should AND all those games get added into the win rate graph despite their lower quality.
|
On January 03 2016 07:12 TheWinks wrote:Show nested quote +On January 03 2016 06:54 Nebuchad wrote:On January 03 2016 04:54 Lexender wrote:On January 03 2016 04:48 TheWinks wrote:On January 03 2016 03:48 BronzeKnee wrote:On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result. I remember when ByuN was being number 1 terran, in the middle of HotS We know how it works. When people play a lot of online tournaments, they end up advancing their rating way more (and way easier) than the people who play only GSL and the occasional week-end tournament, even though they are playing weaker opposition. You have demonstrated that the ranking is flawed, but that's completely different from collecting results and calculating a win percentage based on them. What is described as "garbage" is simply things that contradict the narrative you're pulling for. The two things you're describing are linked. If a top or near top level Korean goes into an online tournament and wipes the floor with a bunch of foreigners he gets a bigger boost in aligulac rating that he really should AND all those games get added into the win rate graph despite their lower quality. and the underlying assumption unless proven differently (statistically or deductively, not by giving a piece of evidence) is: such a player can be of any race, so the winrates get influenced by it in the same ways
also you gotta prove that the samplesize is small enough for it mattering to begin with. time for some math if you want to support your hypothesis
|
On January 03 2016 08:22 Big J wrote:Show nested quote +On January 03 2016 07:12 TheWinks wrote:On January 03 2016 06:54 Nebuchad wrote:On January 03 2016 04:54 Lexender wrote:On January 03 2016 04:48 TheWinks wrote:On January 03 2016 03:48 BronzeKnee wrote:On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result. I remember when ByuN was being number 1 terran, in the middle of HotS We know how it works. When people play a lot of online tournaments, they end up advancing their rating way more (and way easier) than the people who play only GSL and the occasional week-end tournament, even though they are playing weaker opposition. You have demonstrated that the ranking is flawed, but that's completely different from collecting results and calculating a win percentage based on them. What is described as "garbage" is simply things that contradict the narrative you're pulling for. The two things you're describing are linked. If a top or near top level Korean goes into an online tournament and wipes the floor with a bunch of foreigners he gets a bigger boost in aligulac rating that he really should AND all those games get added into the win rate graph despite their lower quality. and the underlying assumption unless proven differently (statistically or deductively, not by giving a piece of evidence) is: such a player can be of any race, so the winrates get influenced by it in the same ways also you gotta prove that the samplesize is small enough for it mattering to begin with. time for some math if you want to support your hypothesis There is clearly not an equal race distribution just by looking at the balance report itself.
TvZ: 987 PvT: 635 PvZ: 1061
Why would we assume what you're saying? Even if low quality games did mostly cancel each other out, why include them? It's unnecessary noise. Also, your second sentence doesn't make any sense.
|
Now I don't feel so bad for having a 30% win rate in PvZ.
|
Lots of noise due to skill mismatch will have a tendency to wash out signal, pushing things towards 50% winrate. In other words, by symmetry there's no reason to expect that a much-lower skilled Z plays a higher skilled P more often than the other way around.
So if you have a large number of samples (like aligulac) and still see a big deviation like we do with PvZ, that's a pretty strong indication that there's a problem.
|
On January 03 2016 09:17 Athenau wrote: In other words, by symmetry there's no reason to expect that a much-lower skilled Z plays a higher skilled P more often than the other way around. There's no reason to make this assumption though. We clearly have a race population mismatch.
|
On January 03 2016 08:43 TheWinks wrote:Show nested quote +On January 03 2016 08:22 Big J wrote:On January 03 2016 07:12 TheWinks wrote:On January 03 2016 06:54 Nebuchad wrote:On January 03 2016 04:54 Lexender wrote:On January 03 2016 04:48 TheWinks wrote:On January 03 2016 03:48 BronzeKnee wrote:On January 03 2016 03:48 TheWinks wrote: If we had blindly followed aligulac win rates the widow mine revert would have never happened. Aligulac's "balance" page has always been a poor source of information. Why would we blindly follow the win rates? I don't see anyone arguing for that. They are a source of information to be considered. But not ignored. Therefore we should neither follow them blindly, nor totally discard them. The fact that PvZ is at it's worst point in terms of win rates ever should be very concerning and is cause for some kind of change. Aligulac's win rates are worth ignoring. There's too much garbage included that obscures the end result. I remember when ByuN was being number 1 terran, in the middle of HotS We know how it works. When people play a lot of online tournaments, they end up advancing their rating way more (and way easier) than the people who play only GSL and the occasional week-end tournament, even though they are playing weaker opposition. You have demonstrated that the ranking is flawed, but that's completely different from collecting results and calculating a win percentage based on them. What is described as "garbage" is simply things that contradict the narrative you're pulling for. The two things you're describing are linked. If a top or near top level Korean goes into an online tournament and wipes the floor with a bunch of foreigners he gets a bigger boost in aligulac rating that he really should AND all those games get added into the win rate graph despite their lower quality. and the underlying assumption unless proven differently (statistically or deductively, not by giving a piece of evidence) is: such a player can be of any race, so the winrates get influenced by it in the same ways also you gotta prove that the samplesize is small enough for it mattering to begin with. time for some math if you want to support your hypothesis There is clearly not an equal race distribution just by looking at the balance report itself. TvZ: 987 PvT: 635 PvZ: 1061 Why would we assume what you're saying? Even if low quality games did mostly cancel each other out, why include them? It's unnecessary noise. Also, your second sentence doesn't make any sense. I meant such players are distributed in the same way as the rest of the sample, not equally distributed. and i do it because it's the reasonable thing to do unless you actually create an objective criterion when a player outclasses the competition and then actually count the instances when it happened that such a player wiped the floor with others (and compare it across the races. my assumption: it's similar to the racial representation). everything else is delusional. that's why comments such as yours trigger me to respond in such a way. you try to diminish numbers without doing actual work. you give an example of something that could or does happen, but you don't do the real work behind it which is grinding the numbers why your example actually deserves to be mentioned. creating hypothesis is always nice. but that's not work, the actual work is giving your hypothesis significance and you don't do that by spitting out single names in the context of thousands of data points. just do the statistics if you are so sure you can show the numbers are meaningless.
and why include them? to cut them you need a criterion by what you cut. good luck creating one.
|
There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric.
|
On January 03 2016 09:30 Big J wrote: that's why comments such as yours trigger me to respond in such a way. you try to diminish numbers without doing actual work. Just because someone assembles numbers doesn’t mean someone else has to generate their own database to criticize them. A quick count the first GSL pre-season qualifier, ignoring walkovers, had these no-names: 9 protoss, 11 terrans, and 7 zergs. Every single one was beaten by the first notable player they reached. Ignoring mirrors we had these matchups (notable player is the first race):
TvP: 5 PvT: 4 ZvP: 7 PvZ: 1 TvZ: 2 ZvT: 4
A quick count of ZvP/PvZs in the second preseason qual had 3 and 4. Even if we argue about who's "notable", there's no reason to assume numbers are going to magically balance out and they have an impact on win rates.
On January 03 2016 09:51 Athenau wrote:Show nested quote +There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. The problem is it's not an inherent assumption you can make. For example:
David Kim wrote: It’s the only major tournament going on right now, and it represents a sample size that is too small to draw any broad conclusions from, but Protoss players have lost at a noticeable clip in that tournament. As of this writing, they’ve recorded only 11 wins in 35 non-mirror matchups.
When this happened far more protoss were being fielded and hardly any terrans. The terrans seeing play were disproportionally higher skilled terrans. There was a ~50% win rate, but the average skill of the players being fielded was higher for Terran. This is the danger of just assuming everything cancels out.
|
During Zerg dominance near the end of WoL, aside from win-rate, mirror-matchup count was significantly higher for Zergs. Protoss too were relatively well represented, since they could soul-train zergs before reaching BL/infestor.
/edit
I did some digging around. Here is what I have found so far: Aligulac was used in this Bnet thread to justify balance during Brood/Infestor Era. Aligulac List 100 was posted as evidence.
Now in hindsight, we all acknowledge that Brood/Infestor Era was imbalanced. Here is the balance report for the period of List 100 in Aligulac. Note the mirror matchup count.
![[image loading]](http://i.imgur.com/WaQQFDq.jpg?1)
Here's a look at the most current period of Aligulac:
![[image loading]](http://i.imgur.com/aRNOTeV.jpg?1)
Zerg strength in both periods is strongly indicated by the mirror matchup count.
Links to the Aligulac pages: http://aligulac.com/periods/153 http://aligulac.com/periods/100
|
On January 03 2016 09:51 Athenau wrote:Show nested quote +There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric.
The total pool of players are not meeting each other randomly. They advance through tournaments, requiring them to win in the first place.
|
On January 03 2016 10:49 plogamer wrote:+ Show Spoiler +During Zerg dominance near the end of WoL, aside from win-rate, mirror-matchup count was significantly higher for Zergs. Protoss too were relatively well represented, since they could soul-train zergs before reaching BL/infestor. /edit I did some digging around. Here is what I have found so far: Aligulac was used in this Bnet thread to justify balance during Brood/Infestor Era. Aligulac List 100 was posted as evidence. Now in hindsight, we all acknowledge that Brood/Infestor Era was imbalanced. Here is the balance report for the period of List 100 in Aligulac. Note the mirror matchup count.![[image loading]](http://i.imgur.com/WaQQFDq.jpg?1) Here's a look at the most current period of Aligulac: ![[image loading]](http://i.imgur.com/aRNOTeV.jpg?1) Zerg strength in both periods is strongly indicated by the mirror matchup count. Links to the Aligulac pages: http://aligulac.com/periods/153 http://aligulac.com/periods/100
Yes, it's actually quite simple come to think of it. In a tournament where you have to qualify to compete it is natural that the competing players actually have a fighting chance against each other. If one race has an advantage in the meta, the result would be an overrepresentation of players of that race, but this means that the average skill level of the current pool of players playing that race is decreased and vice versa. Hence the top players of other races will do decently against them despite the disadvantage. All in all, in the format of tournaments requiring qualification it might just be a mathematical fact that the average winrate of each racial matchup will be equal in the long run.
Don't confuse this with blizzards statistics. They are doing a sophisticated statistical analysis of the ladder as a whole, taking all factors (such as MMR) in consideration to give a meaningful balance statistic as far as this is possible.
I've actually always thought that race representation in high level tournaments is the best indicator of balance at the top level. Even racial representation in GM could be a good indicator (although possibly not, as the players of a disadvantaged race could be more likely to ladder, since they are less likely to occupied with practicing for a tournament match).
|
On January 03 2016 09:51 Athenau wrote:Show nested quote +There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too.
|
On January 03 2016 11:50 Lexender wrote:Show nested quote +On January 03 2016 09:51 Athenau wrote:There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too.
This is exactly why it makes sense to weight the win/loss statistics according to the players respective ELO rank parameters. So that if a zerg player has a 60% chance of winning against a lower level protoss, a win will be weighted as some number < 1, and conversely the protoss winning will be weighted by some number > 1.
However, given an imbalance meta, I suspect that in time as the ELO rankings will adjust and stabilize, it will stop representing the relative skill levels between players, and rather reflect a combination of skill level and current racial advantages/disadvantages. So in time, this weighted calculation might stabilize around even racial winrates. I would appreciate someone well-versed in statistics to chime in on this.
|
On January 03 2016 11:59 cheekymonkey wrote:Show nested quote +On January 03 2016 11:50 Lexender wrote:On January 03 2016 09:51 Athenau wrote:There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too. This is exactly why it makes sense to weight the win/loss statistics according to the players respective ELO rank parameters. So that if a zerg player has a 60% chance of winning against a lower level protoss, a win will be weighted as some number < 1, and conversely the protoss winning will be weighted by some number > 1. However, given an imbalance meta, I suspect that in time as the ELO rankings will adjust and stabilize, it will stop representing the relative skill levels between players, and rather reflect a combination of skill level and current racial advantages/disadvantages. So in time, this weighted calculation might stabilize around even racial winrates. I would appreciate someone well-versed in statistics to chime in on this.
What you're asking for is the bottom graph in the Aligulac report. But you run into the same problem here. Racial balance influences players' Elos, much like player skill influences overall winrates, so it'll always trend towards 0. The only thing it might help you with is determining how a change affects a matchup. E.g. if the map pool changes and you see zerg shoot up, you know the new pool is more zerg favourable than the last one - but only as a comparison to the previous pool, not that it's necessarily 'good'. And you'll see it fall back to even as Elos adjust.
EDIT: Unrelated, but whenever these threads pop up, you'll always have one party saying that the statistics are definitive proof, and probably using p-values from binomial tests with invalid assumptions. Then you'll have another saying that they should just be completely ignored because of selection bias and they're not independent and players have differing skills. Funny how the people treating them as gospel play the race doing poorly, and those claiming it's invalid are the ones doing well.
|
On January 03 2016 13:06 dainbramage wrote:Show nested quote +On January 03 2016 11:59 cheekymonkey wrote:On January 03 2016 11:50 Lexender wrote:On January 03 2016 09:51 Athenau wrote:There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too. This is exactly why it makes sense to weight the win/loss statistics according to the players respective ELO rank parameters. So that if a zerg player has a 60% chance of winning against a lower level protoss, a win will be weighted as some number < 1, and conversely the protoss winning will be weighted by some number > 1. However, given an imbalance meta, I suspect that in time as the ELO rankings will adjust and stabilize, it will stop representing the relative skill levels between players, and rather reflect a combination of skill level and current racial advantages/disadvantages. So in time, this weighted calculation might stabilize around even racial winrates. I would appreciate someone well-versed in statistics to chime in on this. What you're asking for is the bottom graph in the Aligulac report. But you run into the same problem here. Racial balance influences players' Elos, much like player skill influences overall winrates, so it'll always trend towards 0. The only thing it might help you with is determining how a change affects a matchup. E.g. if the map pool changes and you see zerg shoot up, you know the new pool is more zerg favourable than the last one - but only as a comparison to the previous pool, not that it's necessarily 'good'. And you'll see it fall back to even as Elos adjust. EDIT: Unrelated, but whenever these threads pop up, you'll always have one party saying that the statistics are definitive proof, and probably using p-values from binomial tests with invalid assumptions. Then you'll have another saying that they should just be completely ignored because of selection bias and they're not independent and players have differing skills. Funny how the people treating them as gospel play the race doing poorly, and those claiming it's invalid are the ones doing well.
Im EU GM and I think balance is all about statistics, excuse me?
|
On January 03 2016 13:06 dainbramage wrote:Show nested quote +On January 03 2016 11:59 cheekymonkey wrote:On January 03 2016 11:50 Lexender wrote:On January 03 2016 09:51 Athenau wrote:There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too. This is exactly why it makes sense to weight the win/loss statistics according to the players respective ELO rank parameters. So that if a zerg player has a 60% chance of winning against a lower level protoss, a win will be weighted as some number < 1, and conversely the protoss winning will be weighted by some number > 1. However, given an imbalance meta, I suspect that in time as the ELO rankings will adjust and stabilize, it will stop representing the relative skill levels between players, and rather reflect a combination of skill level and current racial advantages/disadvantages. So in time, this weighted calculation might stabilize around even racial winrates. I would appreciate someone well-versed in statistics to chime in on this. EDIT: Unrelated, but whenever these threads pop up, you'll always have one party saying that the statistics are definitive proof, and probably using p-values from binomial tests with invalid assumptions. Then you'll have another saying that they should just be completely ignored because of selection bias and they're not independent and players have differing skills. Funny how the people treating them as gospel play the race doing poorly, and those claiming it's invalid are the ones doing well.
So... you mean people are biased toward the race they play and/or like? Man, you just blew my world right now, thanks a lot for clearing that up.
As far as I know, I've always made it clear that I'm biased for protoss. I think the people who pretend not to be biased are either delusional or attempting to hide their agenda. And when my side presents an argumentation, for example, saying that when a match-up is under 50% and trending consistently downwards for the last three months, and said match-up is about to get patched with two pretty important nerfs to the downtrending race, it is reasonable to have some concerns, I'd like a little more than "yeah but you're biased" in return.
But still, thanks.
|
On January 03 2016 10:49 plogamer wrote:+ Show Spoiler +During Zerg dominance near the end of WoL, aside from win-rate, mirror-matchup count was significantly higher for Zergs. Protoss too were relatively well represented, since they could soul-train zergs before reaching BL/infestor. /edit I did some digging around. Here is what I have found so far: Aligulac was used in this Bnet thread to justify balance during Brood/Infestor Era. Aligulac List 100 was posted as evidence. Now in hindsight, we all acknowledge that Brood/Infestor Era was imbalanced. Here is the balance report for the period of List 100 in Aligulac. Note the mirror matchup count.![[image loading]](http://i.imgur.com/WaQQFDq.jpg?1) Here's a look at the most current period of Aligulac: ![[image loading]](http://i.imgur.com/aRNOTeV.jpg?1) Zerg strength in both periods is strongly indicated by the mirror matchup count. Links to the Aligulac pages: http://aligulac.com/periods/153 http://aligulac.com/periods/100
I didn't read through all of this so I won't participate in the discussion, just stopping by to say BL/Infestor was end of 2012/beginning of 2013, not end of 2013, so unless the date in your first graph is shown incorrectly you've got the wrong graph
|
On January 03 2016 13:06 dainbramage wrote:Show nested quote +On January 03 2016 11:59 cheekymonkey wrote:On January 03 2016 11:50 Lexender wrote:On January 03 2016 09:51 Athenau wrote:There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too. This is exactly why it makes sense to weight the win/loss statistics according to the players respective ELO rank parameters. So that if a zerg player has a 60% chance of winning against a lower level protoss, a win will be weighted as some number < 1, and conversely the protoss winning will be weighted by some number > 1. However, given an imbalance meta, I suspect that in time as the ELO rankings will adjust and stabilize, it will stop representing the relative skill levels between players, and rather reflect a combination of skill level and current racial advantages/disadvantages. So in time, this weighted calculation might stabilize around even racial winrates. I would appreciate someone well-versed in statistics to chime in on this. What you're asking for is the bottom graph in the Aligulac report. But you run into the same problem here. Racial balance influences players' Elos, much like player skill influences overall winrates, so it'll always trend towards 0. The only thing it might help you with is determining how a change affects a matchup. E.g. if the map pool changes and you see zerg shoot up, you know the new pool is more zerg favourable than the last one - but only as a comparison to the previous pool, not that it's necessarily 'good'. And you'll see it fall back to even as Elos adjust. EDIT: Unrelated, but whenever these threads pop up, you'll always have one party saying that the statistics are definitive proof, and probably using p-values from binomial tests with invalid assumptions. Then you'll have another saying that they should just be completely ignored because of selection bias and they're not independent and players have differing skills. Funny how the people treating them as gospel play the race doing poorly, and those claiming it's invalid are the ones doing well. And then you have the few that actually can do a proper analysis rather than just blindly apply a method that may or may not make sense to the case. But if you are not one of them, it is close to impossible to separate them from the rest of the pack.
I'm zerg and I have been arguing in this thread that the P > Z signal is real and important, but I guess you also have confirmation bias when you look at the race of posters? People kindof take the easy way out and just go "your biased, thus you are wrong", and somehow takes that as evidence of the opposite ("CIA denied it, so it must be true"). It is perfectly possible to be biased but still get things right. You only have to be more careful that what you are doing actually makes sense, be self-critical and be open to comment from others. You also have to be able to do the analysis to start with...
|
On January 02 2016 20:26 Ghanburighan wrote:This is somewhat disingenuous by Bronzeknee as such stats have been discussed in the designated dalance discussion thread already and been found wanting. Bronzeknee was part of these discussions so he should know better. That's not to say that there isn't an early indication of a problem in PvZ.
Disingenuous? No, I'm actually totally sincere in posting this. I haven't participated in that discussion in literally years. Probably, since around the time of the release of HOTS (likely even further back).
But I do remember you quite clearly arguing for long periods of time that we should adopt a wait and see approach, as you've stated in this thread. I've always found that to be a very ignorant thing to do in light of massive imbalance (PvZ has never been this imbalanced for either side).
The fact that we don't know what we don't know is not a reason to do nothing about what we do know.
And it never will be.
|
On January 02 2016 16:59 BronzeKnee wrote:
Protoss is pretty much in free fall, especially in PvZ (haven't had a win rate that imbalanced for three years, and PvZ is more imbalanced than ever), and yet nerfs are planned for Pylon Overcharge and the Adept... interesting.
It's also interesting how you conveniently forget to mention that there are 2 significant Zerg nerfs on the horizon: Zergling attack speed upgrade bonus decreased from 40% to 30% and Viper spell damage reduced from 90 to 60.
The PO i'd call more of a change rather then nerf, as it get stronger in some situations and not so much in others.
|
On January 03 2016 13:06 dainbramage wrote:Show nested quote +On January 03 2016 11:59 cheekymonkey wrote:On January 03 2016 11:50 Lexender wrote:On January 03 2016 09:51 Athenau wrote:There's no reason to make this assumption though. We clearly have a race population mismatch.
Relative size doesn't matter. Even if you have, for example, a population of 100 zerg players and only 10 protoss players, the number of ways to match a top 10% zerg player with a bottom 10% protoss player is the same as the other way around. The problem is symmetric. No because its not a randomized experiment where you check all variants, if there is 100 zerg players and 10 protoss players, sure at some point a top zerg and a top protoss will meet, but until that point the protoss players may have defeated 10 bottom zerg players while the zerg player may have played ten mirrors wich will skew balance, wich is why not only non-mirrors have to be checked but mirrors too. This is exactly why it makes sense to weight the win/loss statistics according to the players respective ELO rank parameters. So that if a zerg player has a 60% chance of winning against a lower level protoss, a win will be weighted as some number < 1, and conversely the protoss winning will be weighted by some number > 1. However, given an imbalance meta, I suspect that in time as the ELO rankings will adjust and stabilize, it will stop representing the relative skill levels between players, and rather reflect a combination of skill level and current racial advantages/disadvantages. So in time, this weighted calculation might stabilize around even racial winrates. I would appreciate someone well-versed in statistics to chime in on this. What you're asking for is the bottom graph in the Aligulac report. But you run into the same problem here. Racial balance influences players' Elos, much like player skill influences overall winrates, so it'll always trend towards 0. The only thing it might help you with is determining how a change affects a matchup. E.g. if the map pool changes and you see zerg shoot up, you know the new pool is more zerg favourable than the last one - but only as a comparison to the previous pool, not that it's necessarily 'good'. And you'll see it fall back to even as Elos adjust.
Wow, I completely missed the bottom graph. It addresses my second question exactly. It can give some indication of imbalance though, by looking at the overall increase in ratings for each race. If a race on average got a higher ranking during the span of a month, then this implies that something has changed with the balance of the game/meta.
But I suspect that even the flat racial winrates will stabilize around 50% due to tournament qualification.
|
On January 03 2016 20:56 Sapphire.lux wrote:Show nested quote +On January 02 2016 16:59 BronzeKnee wrote:
Protoss is pretty much in free fall, especially in PvZ (haven't had a win rate that imbalanced for three years, and PvZ is more imbalanced than ever), and yet nerfs are planned for Pylon Overcharge and the Adept... interesting.
It's also interesting how you conveniently forget to mention that there are 2 significant Zerg nerfs on the horizon: Zergling attack speed upgrade bonus decreased from 40% to 30% and Viper spell damage reduced from 90 to 60. The PO i'd call more of a change rather then nerf, as it get stronger in some situations and not so much in others.
I didn't mention the Zerg nerfs because Zerg isn't suffering. There is some irony when a race that is doing poorly is receiving nerfs without corresponding buffs.
|
EDIT: oops posted this to the wrong thread!
|
lol that PvZ stat warms my cold black heart.
|
|
|
|