• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 05:42
CEST 11:42
KST 18:42
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Serral wins EWC 202515Tournament Spotlight: FEL Cracow 20259Power Rank - Esports World Cup 202580RSL Season 1 - Final Week9[ASL19] Finals Recap: Standing Tall15
Community News
[BSL 2025] H2 - Team Wars, Weeklies & SB Ladder2EWC 2025 - Replay Pack2Google Play ASL (Season 20) Announced27BSL Team Wars - Bonyth, Dewalt, Hawk & Sziky teams10Weekly Cups (July 14-20): Final Check-up0
StarCraft 2
General
Serral wins EWC 2025 #1: Maru - Greatest Players of All Time Greatest Players of All Time: 2025 Update Power Rank - Esports World Cup 2025 EWC 2025 - Replay Pack
Tourneys
Sparkling Tuna Cup - Weekly Open Tournament FEL Cracov 2025 (July 27) - $10,000 live event TaeJa vs Creator Bo7 SC Evo Showmatch Esports World Cup 2025 $25,000 Streamerzone StarCraft Pro Series announced
Strategy
How did i lose this ZvP, whats the proper response
Custom Maps
External Content
Mutation # 484 Magnetic Pull Mutation #239 Bad Weather Mutation # 483 Kill Bot Wars Mutation # 482 Wheel of Misfortune
Brood War
General
Google Play ASL (Season 20) Announced Shield Battery Server New Patch BW General Discussion [BSL 2025] H2 - Team Wars, Weeklies & SB Ladder BGH Auto Balance -> http://bghmmr.eu/
Tourneys
[Megathread] Daily Proleagues [BSL20] Non-Korean Championship 4x BSL + 4x China CSL Xiamen International Invitational [CSLPRO] It's CSLAN Season! - Last Chance
Strategy
Does 1 second matter in StarCraft? Simple Questions, Simple Answers Muta micro map competition [G] Mineral Boosting
Other Games
General Games
Stormgate/Frost Giant Megathread Nintendo Switch Thread Total Annihilation Server - TAForever [MMORPG] Tree of Savior (Successor of Ragnarok) Path of Exile
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Vanilla Mini Mafia
Community
General
US Politics Mega-thread Russo-Ukrainian War Thread UK Politics Mega-thread Stop Killing Games - European Citizens Initiative Things Aren’t Peaceful in Palestine
Fan Clubs
INnoVation Fan Club SKT1 Classic Fan Club!
Media & Entertainment
Anime Discussion Thread [\m/] Heavy Metal Thread Movie Discussion! [Manga] One Piece Korean Music Discussion
Sports
2024 - 2025 Football Thread Formula 1 Discussion TeamLiquid Health and Fitness Initiative For 2023 NBA General Discussion
World Cup 2022
Tech Support
Gtx660 graphics card replacement Installation of Windows 10 suck at "just a moment" Computer Build, Upgrade & Buying Resource Thread
TL Community
TeamLiquid Team Shirt On Sale The Automated Ban List
Blogs
Ping To Win? Pings And Their…
TrAiDoS
momentary artworks from des…
tankgirl
from making sc maps to makin…
Husyelt
StarCraft improvement
iopq
Socialism Anyone?
GreenHorizons
Eight Anniversary as a TL…
Mizenhauer
Customize Sidebar...

Website Feedback

Closed Threads



Active: 580 users

Blizzard's "skill-adjusted-win-percentages" - Page 5

Forum Index > SC2 General
Post a Reply
Prev 1 2 3 4 5 6 7 Next All
Lysenko
Profile Blog Joined April 2010
Iceland2128 Posts
August 05 2011 04:54 GMT
#81
On August 05 2011 13:51 kckkryptonite wrote:
It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted.


It takes a year of calculus to read it, understanding it either requires some statistical knowledge, or they were joking.

In any case, it clearly wasn't presented to convey information, and if it is, as someone else above speculated, something related to a maximum likelihood calculation involved in the matchmaking system, it's quite likely that none of the people speaking on that stage were fully up to speed on the statistics involved.
http://en.wikipedia.org/wiki/Lysenkoism
kckkryptonite
Profile Blog Joined July 2010
1126 Posts
August 05 2011 05:07 GMT
#82
On August 05 2011 13:54 Lysenko wrote:
Show nested quote +
On August 05 2011 13:51 kckkryptonite wrote:
It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted.


It takes a year of calculus to read it, understanding it either requires some statistical knowledge, or they were joking.

In any case, it clearly wasn't presented to convey information, and if it is, as someone else above speculated, something related to a maximum likelihood calculation involved in the matchmaking system, it's quite likely that none of the people speaking on that stage were fully up to speed on the statistics involved.


If you can read it, you can at the very least interpret it. It's like you're saying you might be able to read Korean, but not understand it. Not divulging more than some arbitrary equation clearly tells us that Blizzard doesn't want to tell us anything other than imply they have a big magical formula done by 5 PhDs.

+ Show Spoiler +
Or a monkey.
RIP avilo, qxc keyboard 2013, RIP Nathanis keyboard 2014
Drowsy
Profile Blog Joined November 2005
United States4876 Posts
Last Edited: 2011-08-05 05:21:26
August 05 2011 05:14 GMT
#83
ohhhh my god David Kim is sooo cute.

I didn't realize this was Oct 2010 at first. I was shocked at the stats they were going over.
Our Protoss, Who art in Aiur HongUn be Thy name; Thy stalker come, Thy will be blunk, on ladder as it is in Micro Tourny. Give us this win in our daily ladder, and forgive us our cheeses, As we forgive those who play zerg against us.
Alyoshka
Profile Joined July 2010
United States10 Posts
August 05 2011 05:15 GMT
#84
On August 05 2011 13:51 kckkryptonite wrote:
Show nested quote +
On August 04 2011 11:22 seaofsaturn wrote:
The whole purpose of differential equations is to measure things that are constantly changing...

Here is the differential equation from the video:

[image loading]

If you can't make sense of that (I can't!) then I don't know why you're trying to criticize them. The percentages are just simplified representations to present the data to people who aren't math majors, you can't really use them to support random theories.



It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted. Lol at Blizzard trying to appear transparent, patronization at its best, imo.

"We'll spare you the details, but these are the percentages", sketchy.


you need more than one year of calculus to understand this type of equation. Cal I/II don't even sniff DEs. All the posts in this thread are total crap except those which point out that <1% of the population comprehends the math involved. The details aren't important, because it works. I am amazed at the number of numbskulls who piss and moan about this or that policy from blizzard without doing any anything to contribute to the solution side of things.

Math is extremely hard, the kind of programming talent Blizzard can hire, while not Google/MSFT/AAPL level, is incredibly high. Just be glad that the smartest guys in the gaming industry are working on the IP you love.

citation: http://www.animationarena.com/video-game-salary.html (on Blizz leading the way for pay, which in turn allows them to leverage top talent)

actual data of the survey: https://spreadsheets.google.com/ccc?key=0Aou3k7ExaTQjdHZ0S2dKMjhfY0lmN2tmTDRESEhjbHc&hl=en&authkey=CNDxyJwF#gid=0

wiki post on DiffE: http://en.wikipedia.org/wiki/Differential_equation

LagT_T
Profile Joined March 2010
Argentina535 Posts
August 05 2011 05:31 GMT
#85
On August 05 2011 13:51 kckkryptonite wrote:
Show nested quote +
On August 04 2011 11:22 seaofsaturn wrote:
The whole purpose of differential equations is to measure things that are constantly changing...

Here is the differential equation from the video:

[image loading]

If you can't make sense of that (I can't!) then I don't know why you're trying to criticize them. The percentages are just simplified representations to present the data to people who aren't math majors, you can't really use them to support random theories.



It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted. Lol at Blizzard trying to appear transparent, patronization at its best, imo.

"We'll spare you the details, but these are the percentages", sketchy.


Greek letters have defined meanings in statistical analysis, they are not unpredefined variables like for example the common latin/roman letter "x".
"The tactics... no. Amateurs discuss tactics, professional soldiers study logistics." - Tom Clancy, Red Storm Rising
Disquiet
Profile Joined January 2011
Australia628 Posts
August 05 2011 05:34 GMT
#86
On August 05 2011 14:15 Alyoshka wrote:
Show nested quote +
On August 05 2011 13:51 kckkryptonite wrote:
On August 04 2011 11:22 seaofsaturn wrote:
The whole purpose of differential equations is to measure things that are constantly changing...

Here is the differential equation from the video:

[image loading]

If you can't make sense of that (I can't!) then I don't know why you're trying to criticize them. The percentages are just simplified representations to present the data to people who aren't math majors, you can't really use them to support random theories.



It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted. Lol at Blizzard trying to appear transparent, patronization at its best, imo.

"We'll spare you the details, but these are the percentages", sketchy.


you need more than one year of calculus to understand this type of equation. Cal I/II don't even sniff DEs. All the posts in this thread are total crap except those which point out that <1% of the population comprehends the math involved. The details aren't important, because it works. I am amazed at the number of numbskulls who piss and moan about this or that policy from blizzard without doing any anything to contribute to the solution side of things.

Math is extremely hard, the kind of programming talent Blizzard can hire, while not Google/MSFT/AAPL level, is incredibly high. Just be glad that the smartest guys in the gaming industry are working on the IP you love.

citation: http://www.animationarena.com/video-game-salary.html (on Blizz leading the way for pay, which in turn allows them to leverage top talent)

actual data of the survey: https://spreadsheets.google.com/ccc?key=0Aou3k7ExaTQjdHZ0S2dKMjhfY0lmN2tmTDRESEhjbHc&hl=en&authkey=CNDxyJwF#gid=0

wiki post on DiffE: http://en.wikipedia.org/wiki/Differential_equation



I agree he is wrong. even without having the variables defined you can still tell what the thing does if you can understand it. Everyone can recognize the formula for a parabola without knowing how x or y is applied.
Lysenko
Profile Blog Joined April 2010
Iceland2128 Posts
August 05 2011 05:44 GMT
#87
On August 05 2011 14:34 Disquiet wrote:
I agree he is wrong. even without having the variables defined you can still tell what the thing does if you can understand it. Everyone can recognize the formula for a parabola without knowing how x or y is applied.


Actually, when it comes to statistics, that's not true. Here's why: every technique that exists for analyzing data sets statistically has implicit assumptions that must be true before the technique tells you what it purports to.

Here's an example: The mean and standard deviation have different meanings if you're looking at a normal vs. a Poisson distribution. When is it appropriate to presume each type of distribution? The answer isn't found in the mathematical equations that describe the distributions' shapes!

http://en.wikipedia.org/wiki/Lysenkoism
Perseverance
Profile Joined February 2010
Japan2800 Posts
August 05 2011 05:52 GMT
#88
I wonder how blizzard feels about their game now.
<3 Moonbattles
Hikari
Profile Blog Joined May 2010
1914 Posts
August 05 2011 05:58 GMT
#89
Rewatched the vid:
The powerful terran early game is still a problem which DB recognizes. Yet it is not something easily fixable without nerfing mid/late game. By design the race is like that and I think we will have to wait til HotS for the problem to truly be "fixed".
kckkryptonite
Profile Blog Joined July 2010
1126 Posts
August 05 2011 06:01 GMT
#90
On August 05 2011 14:15 Alyoshka wrote:
Show nested quote +
On August 05 2011 13:51 kckkryptonite wrote:
On August 04 2011 11:22 seaofsaturn wrote:
The whole purpose of differential equations is to measure things that are constantly changing...

Here is the differential equation from the video:

[image loading]

If you can't make sense of that (I can't!) then I don't know why you're trying to criticize them. The percentages are just simplified representations to present the data to people who aren't math majors, you can't really use them to support random theories.



It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted. Lol at Blizzard trying to appear transparent, patronization at its best, imo.

"We'll spare you the details, but these are the percentages", sketchy.


you need more than one year of calculus to understand this type of equation. Cal I/II don't even sniff DEs. All the posts in this thread are total crap except those which point out that <1% of the population comprehends the math involved. The details aren't important, because it works. I am amazed at the number of numbskulls who piss and moan about this or that policy from blizzard without doing any anything to contribute to the solution side of things.

Math is extremely hard, the kind of programming talent Blizzard can hire, while not Google/MSFT/AAPL level, is incredibly high. Just be glad that the smartest guys in the gaming industry are working on the IP you love.

citation: http://www.animationarena.com/video-game-salary.html (on Blizz leading the way for pay, which in turn allows them to leverage top talent)

actual data of the survey: https://spreadsheets.google.com/ccc?key=0Aou3k7ExaTQjdHZ0S2dKMjhfY0lmN2tmTDRESEhjbHc&hl=en&authkey=CNDxyJwF#gid=0

wiki post on DiffE: http://en.wikipedia.org/wiki/Differential_equation


No, you don't. The level of ignorance in your post is astonishing, after the first year of Calc, you are be able to solve basic differential equations (in my curriculum at least). Pouring money into something must mean it's the best right (US HEALTHCARE/EDUCATION)? To top it off you cite wikipedia.

On August 05 2011 14:15 Alyoshka wrote:
All the posts in this thread are total crap except those which point out that <1% of the population comprehends the math involved.


Really? WTF. There are derivatives and integrals, fractions and exponents. Seriously? 1%? Where did you get this number? How are you coming to your various conclusions?

On August 05 2011 14:34 Disquiet wrote:
I agree he is wrong. even without having the variables defined you can still tell what the thing does if you can understand it. Everyone can recognize the formula for a parabola without knowing how x or y is applied.

Actually, the variables are assumed to be defined as the set of all real numbers.

W/e guys, I'm not gonna get into a math debate with people who know how to use google and wikipedia.
RIP avilo, qxc keyboard 2013, RIP Nathanis keyboard 2014
Slago
Profile Joined August 2010
Canada726 Posts
August 05 2011 06:03 GMT
#91
it seems there main concern is making a player satisfied and happy by giving them the 50% win ratio, but aren't all that concerned with how it misconstrues balance data, so their risking some more reliable numbers for a better experience for the consumer, probably a good move by them
I came here to kick ass and chew bubble gum and I'm all out of... ah forget it
Lysenko
Profile Blog Joined April 2010
Iceland2128 Posts
Last Edited: 2011-08-05 06:10:45
August 05 2011 06:09 GMT
#92
On August 05 2011 15:03 Slago wrote:
it seems there main concern is making a player satisfied and happy by giving them the 50% win ratio, but aren't all that concerned with how it misconstrues balance data, so their risking some more reliable numbers for a better experience for the consumer, probably a good move by them


This idea that a 50% individual win ratio is not compatible with a statistical data set that can be used to detect race-wide imbalances is just not true, no matter how much people say it. That individuals are being matched against other individuals with whom they have a 50/50 chance to win says nothing about the information that the overall distributions can communicate.
http://en.wikipedia.org/wiki/Lysenkoism
aksfjh
Profile Joined November 2010
United States4853 Posts
Last Edited: 2011-08-05 06:20:22
August 05 2011 06:13 GMT
#93
On August 05 2011 13:51 kckkryptonite wrote:
Show nested quote +
On August 04 2011 11:22 seaofsaturn wrote:
The whole purpose of differential equations is to measure things that are constantly changing...

Here is the differential equation from the video:

[image loading]

If you can't make sense of that (I can't!) then I don't know why you're trying to criticize them. The percentages are just simplified representations to present the data to people who aren't math majors, you can't really use them to support random theories.



It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted. Lol at Blizzard trying to appear transparent, patronization at its best, imo.

"We'll spare you the details, but these are the percentages", sketchy.


This is a cleaned up version:
[image loading]

At the very least, you can infer their equation takes into account standard deviation. Beyond that, there is more there than something "one year of calculus" can help you understand. You might know the symbols and can figure out the "answer" with the numbers, but one year of calculus will never prepare you for what is actually achieved by the equation itself. I would break some of it down for you, but I'm tired of battling morons in this topic who are here for no other purpose than blindly bashing Blizzard for having foresight far beyond anything they can imagine themselves.

In fact, I'm somewhat surprised that this topic is still alive since the TC all but said outright that he doesn't understand how the system can be used and if it strives to match people on a 50-50 basis, then data from those matches is absolutely worthless. The ONLY person I have seen in this topic with any sort of clarity and education is Lysenko. Because of this, I find it worth the time and effort to address a point he is making:

On August 05 2011 14:44 Lysenko wrote:
Actually, when it comes to statistics, that's not true. Here's why: every technique that exists for analyzing data sets statistically has implicit assumptions that must be true before the technique tells you what it purports to.

Here's an example: The mean and standard deviation have different meanings if you're looking at a normal vs. a Poisson distribution. When is it appropriate to presume each type of distribution? The answer isn't found in the mathematical equations that describe the distributions' shapes!


There is indication that Blizzard has made an attempt to correct some of their statistical analysis back at the end of season 1 and beginning of season 2. We went through this shift and scaling of MMR as well as a "fixing" of certain league thresholds because the actual MMR distribution didn't show a Gaussian curve. As far as active population goes, it's assumed that the system actually produced a log-normal pdf, where players who played more often were ending up with a better MMR on average than players who didn't play as much. In essence, casual players would be "feeding" MMR to people who played more, and since there are more casual than hardcore players, a smaller population was ending up on the high end of the scale compared to the low end.

Because of this corrective action in league assignments, we can at least assume that they are constantly watching and correcting equations to measure data obtained through ladder.
OhMyGawd
Profile Joined February 2011
United States264 Posts
August 05 2011 06:14 GMT
#94
On August 03 2011 13:36 Snaphoo wrote:
Show nested quote +
On August 03 2011 13:34 KiLL_ORdeR wrote:
The third and arguably most important factor that they exclude from that though is map balance. They will never get a perfect rating unless the system takes the maps in account.


Even in terms of position. ZvT close positions on Shattered versus far positions, for example, has got to be pretty skewed.


The saddest part about Close Position maps is that even at a High Masters level i have a higher win % on close pos (about 90%) then on cross positions.

This is mainly because terrans do all'ins or cheesy plays which are easy to stop with proper mechanics.

I don't know if i'm the only on out there.
zomg
Lysenko
Profile Blog Joined April 2010
Iceland2128 Posts
Last Edited: 2011-08-05 07:14:34
August 05 2011 06:27 GMT
#95
On August 05 2011 15:13 aksfjh wrote:
Because of this corrective action in league assignments, we can at least assume that they are constantly watching and correcting equations to measure data obtained through ladder.


That's an interesting change that I'd failed to understand the importance of at the time. Thanks for pointing that out.

Edit: The reason I'd thought that was a quantum-mechanical equation back at Blizzcon is that during the short time they flashed it up on the screen I thought I saw imaginary exponents in there. On looking again right now, I notice that that's not the case.
http://en.wikipedia.org/wiki/Lysenkoism
MilesTeg
Profile Joined September 2010
France1271 Posts
August 05 2011 09:59 GMT
#96
On August 05 2011 13:54 Lysenko wrote:
Show nested quote +
On August 05 2011 13:51 kckkryptonite wrote:
It's funny they put up some supposedly insane math equation (it's not, you need one year of calculus to understand it), but they don't tell you what anything represents; theta, beta, gamma? Equations are meaningless if that information is omitted.


It takes a year of calculus to read it, understanding it either requires some statistical knowledge, or they were joking.

In any case, it clearly wasn't presented to convey information, and if it is, as someone else above speculated, something related to a maximum likelihood calculation involved in the matchmaking system, it's quite likely that none of the people speaking on that stage were fully up to speed on the statistics involved.


They were clearly joking...

I really don't think they have any way of calculating a "clean" win percentage, as I said before it's just a way for them to send the right message to the players (stop caring about balance, just play).

On August 05 2011 15:09 Lysenko wrote:
Show nested quote +
On August 05 2011 15:03 Slago wrote:
it seems there main concern is making a player satisfied and happy by giving them the 50% win ratio, but aren't all that concerned with how it misconstrues balance data, so their risking some more reliable numbers for a better experience for the consumer, probably a good move by them


This idea that a 50% individual win ratio is not compatible with a statistical data set that can be used to detect race-wide imbalances is just not true, no matter how much people say it. That individuals are being matched against other individuals with whom they have a 50/50 chance to win says nothing about the information that the overall distributions can communicate.


Maybe, but that's not at all what Blizzard was trying to say, and has nothing to do with the numbers they gave us which are obviously meaningless.
bmn
Profile Joined August 2010
886 Posts
August 05 2011 10:24 GMT
#97
On August 05 2011 11:54 Lysenko wrote:
Show nested quote +
On August 05 2011 04:09 Ihpares wrote:
- A system that ensures a 50% win rating not only in general, but race to race will hide imbalance by virtue of actively seeking that 50% regardless of skill level. This means two players of identical skill with two different races will both be at 50%, but will have very different MMRs if their respective races are imbalanced against one another.


But the distributions will be different over a large number of players in the imbalanced case. If it's harder to win as Zerg, Zerg players will have systematically lower MMRs, and that'll be visible in the distributions, unless you can make a convincing case that worse players choose Zerg.



I don't get why you keep harping on this -- do you have any convincing case that we should believe the race choice to be skill-independent?

There is absolutely nothing symmetric that would lead to any obvious justification here.

Terran is the only race you really play in the campaign. Why would that not have any effect on how many people, and how many new people (who did not play any other race in SC/BW) choose that race? That will be the only race they have serious experience with from single-player, and it's clear that transitioning from T to P/Z is far from easy if you never played P/Z.

Why do you think that all three races are equally frustrating for low-level players? Is it so? I don't know, but there's no symmetry that would justify this assumption a priori. Two races can easily wall off, one cannot. Two races can easily start playing with certain builds which require little scouting or other adaptation (e.g. 4gate and 3rax), that is _very_ helpful for beginners to get a handle of the race; as Zerg you need to play differently to learn how to play the race.

As Protoss you may lose to many early cheeses if you don't 1-base forge (which won't get you far) and if you aren't very careful about how you spend your chronoboosts (to get sentries if needed) early on. As Terran it's a lot easier to survive if you have a wall, since you can build a bunker regardless of whatever else you were doing, and you already have a rax anyway to fill the bunker.

As Terran your scans cannot be stopped, and they don't require any scouting by a unit, which may or may not make it a lot easier and/or more palatable for a disproportionate (more than 1/3rd) number of people. As Zerg you can try to 6pool every game, which may or may not work at low levels, but this is a significantly different strategy from 2raxing or 2gating in terms of how it needs to be stopped.

All these things are examples of how the races play differently in ways which may very well affect which players (categorized by skill level) choose to play those races. What is your evidence that none of these actually matter?
It is not reasonable to assume an a priori distribution of players that is equal across all races, *especially* given that early on (beta) certain strategies were often clearly dominant and abusive (roaches vs p at 1 supply, reapers before rax and speed nerfs) -- which may also make players switch races.

[To people other than Lysenko: This is not a balance whine, and don't bother replying if you have nothing to add to the actual point.]

Finally, actual quantitative data: http://sc2ranks.com/stats/all/1/all
(This is just the first link I came across, there may be much better numbers. I don't know of any, feel free to reply with them if you do.)

Race distribution by league in bronze: 8.1% random, 32.7% protoss, 39.2% terran, 20.0% zerg.

For every bronze Zerg, there are two bronze Terrans.

If this isn't strong enough evidence to suggest that assuming a priori that all races have roughly equal MMR distributions is not justified, I don't know what is.
Lysenko
Profile Blog Joined April 2010
Iceland2128 Posts
Last Edited: 2011-08-05 11:02:12
August 05 2011 10:37 GMT
#98
On August 05 2011 19:24 bmn wrote:
If this isn't strong enough evidence to suggest that assuming a priori that all races have roughly equal MMR distributions is not justified, I don't know what is.


I don't think that you said what you meant to say. Clearly I'm not assuming a priori that all races have roughly equal MMR distributions -- in fact I'm saying that differences in MMR distribution can yield useful balance information. I am suggesting that it's useful to assume that those differences in MMR distribution come from something else than, say, players of X race being systematically worse than players of Y race.

I'm not even saying that this is the analysis Blizzard is doing -- what I'm saying is that the fact that one can extract useful information from those distributions demonstrates the falsehood of saying that a matching system that tries to make every individual game a 50/50 matchup cannot provide information about differences between races, a falsehood that keeps getting repeated here.

Incidentally, while it's interesting what percentage of players in bronze play each race, that's not that useful by itself either -- you'd at least have to normalize the distributions to account for racial preferences across all skill levels.

And, after doing ALL that, maybe you see there's a bulge in the Terran distribution around bronze, and you match that up to people who have shared their experience of playing the game a little bit coming out of the campaign and then quitting the game. Still, there are ways to test that with the data Blizzard have available, to weed out people who don't stick with the game, for example, or look at the subset who have switched races at least once, or whatever.

Nobody said, least of all me, that interpreting this data would be clean, or could be done without applying qualitative judgement. That said, the idea that the aggregate data is useless for this purpose because the matchmaking system automatically seeks out 50/50 matches for players is simply stupid. There's information there. Sure, interpreting it requires checking it against other sources of information, such as player feedback and the developers' own gut feelings. They said exactly that in the video that's been posted in this thread. It doesn't mean the data's useless -- it's just one input to a much bigger process.

Incidentally: the idea that the matching system exists to provide useful balance data makes me shake my head. That is obviously not the case (since the matching system exists for the sole purpose of ensuring that as few players as possible lose more than half their games).

Final thought: We don't really know whether the MMR information they track is a scalar at all. MMR probably doesn't have different values per matchup because of how they do promotions and the relationship of point scores to MMR, but they might track multiple sigmas per player race or per matchup. This or something like it might explain the multiple parameters in that equation they briefly presented at Blizzcon, and if true would possibly provide a hook by which to come up with race-adjusted skill estimates that might be very useful.
http://en.wikipedia.org/wiki/Lysenkoism
Lysenko
Profile Blog Joined April 2010
Iceland2128 Posts
Last Edited: 2011-08-05 11:24:37
August 05 2011 11:13 GMT
#99
On August 05 2011 12:33 Xevious wrote:
My question is why do they think statistics from lower leagues matter as much as higher ones? To but it bluntly, everyone is so bad in bronze that race imbalances aren't what's going to decide the winner, plain and simple (contrary to plat and above, where people don't get supply blocked at 11).


I don't think this is really Blizzard's attitude. If you look at the balance changes they've actually made, the vast bulk are to tweak issues at the high end, and very few are to address issues in lower leagues, and the one or maybe two I can think of where they mentioned low level players exclusively concerned how easy it was to execute certain rushes at the very start of the game.

On the basis of that, I suspect they're quite OK with some imbalance in the lower leagues, but they really don't want things to be completely out of whack (like 70/30 in some matchup) at any level of play, because they'd like all the races to be at least somewhat accessible to new players.

(Incidentally, they did say explicitly at one point that they were OK with Zerg being somewhat harder to learn for totally new players. This by itself suggests that lower league imbalances are a lesser concern than higher league imbalances.)
http://en.wikipedia.org/wiki/Lysenkoism
bmn
Profile Joined August 2010
886 Posts
August 05 2011 11:29 GMT
#100
On August 05 2011 19:37 Lysenko wrote:
Show nested quote +
On August 05 2011 19:24 bmn wrote:
If this isn't strong enough evidence to suggest that assuming a priori that all races have roughly equal MMR distributions is not justified, I don't know what is.


I don't think that you said what you meant to say. Clearly I'm not assuming a priori that all races have roughly equal MMR distributions -- in fact I'm saying that differences in MMR distribution can yield useful balance information. I am suggesting that it's useful to assume that those differences in MMR distribution come from something else than, say, players of X race being systematically worse than players of Y race.


But won't this assumption just bite you in the ass if it turns out to be wrong?

As you said earlier, you can't trust your results if any part of calculating them relies on assumptions that may not be true.


I'm not even saying that this is the analysis Blizzard is doing -- what I'm saying is that the fact that one can extract useful information from those distributions demonstrates the falsehood of saying that a matching system that tries to make every individual game a 50/50 matchup cannot provide information about differences between races, a falsehood that keeps getting repeated here.


Yes, you're right about that. I'm more interested in whether Blizzard actually extracts useful information than whether it's possible do so, though -- I doubt what they're doing is anywhere near the theoretical limits of what's possible :-)


Incidentally, while it's interesting what percentage of players in bronze play each race, that's not that useful by itself either -- you'd at least have to normalize the distributions to account for racial preferences across all skill levels.


Yes, but if you look at the rest of the page, you'll see that Terrans are not overrepresented by such a huge margin anywhere other than bronze league (at least not up to Grandmaster). That's why I quoted the number.
(Unless I'm misunderstanding what you're saying here...)


And, after doing ALL that, maybe you see there's a bulge in the Terran distribution around bronze, and you match that up to people who have shared their experience of playing the game a little bit coming out of the campaign and then quitting the game. Still, there are ways to test that with the data Blizzard have available, to weed out people who don't stick with the game, for example, or look at the subset who have switched races at least once, or whatever.


It's possible to work around that, I never disputed that. I'm disputing that it's simple, and I'm questioning whether Blizzard actually does all that is necessary.
Sure, you can explain it by saying that this is people who just played the game a little bit and then quit -- my point is that this is just one example of how people of one race can indeed be systematically worse than people of other races. This was just an example to demonstrate that this *does* happen, and this is the most trivial example.
What about the population that keeps playing, then, and doesn't just stop playing after a little bit? There is a myriad of systematic biases I can think of which sound plausible, and there's no easy way to eliminate those from the statistics.

Gut feelings and player feedback are nice data points, but they're not really that great if you're trying to understand systematic skill differences in player skills across a range of skill levels, given that you already don't know how to measure player skill in a fair, race-agnostic way -- so as far as I can tell it'll usually boil down to you making a certain set of assumptions, then fudging the statistics until it looks like they reasonably support your assumption. (This isn't saying that they intentionally do this, but there's no benchmark to verify that their way of measuring player skill across races is accurate.)
And even if you're actually wrong, as long as you're not horribly far off, nobody can contradict you -- only you have the data, only you know the assumptions you made, only you know how you crunched the numbers.


Incidentally: the idea that the matching system exists to provide useful balance data makes me shake my head. That is obviously not the case (since the matching system exists for the sole purpose of ensuring that as few players as possible lose more than half their games).


I don't see anyone suggesting that the match-making system is designed to balance the races.

The outcomes of the matching system is the only data that users have to go by, so it's unavoidable that they will judge balance based on those numbers. What other choice is there beyond blind faith?

Also, why do you shake your head at that? You yourself defend the statement that the match-making system's outcome allows providing information about game balance, and it seems pretty clear that the match-making system's outcomes are used by Blizzard to keep track of balance; whether that was the original purpose of the system is entirely irrelevant in this context.


Final thought: We don't really know whether the MMR information they track is a scalar at all. MMR probably doesn't have different values per matchup because of how they do promotions and the relationship of point scores to MMR, but they might track multiple sigmas per player race or per matchup. This or something like it might explain the multiple parameters in that equation they briefly presented at Blizzcon, and if true would possibly provide a hook by which to come up with race-adjusted skill estimates that might be very useful.


Now you're just muddying the waters by saying that we can't possibly know what they do, so we have no reason to criticize anything they say, because maybe they're doing something brilliant and we'll never know.
That's a cop-out :-)
Prev 1 2 3 4 5 6 7 Next All
Please log in or register to reply.
Live Events Refresh
Next event in 18m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Nina 184
StarCraft: Brood War
Bisu 980
Soma 434
Nal_rA 434
Killer 315
EffOrt 232
Mini 212
ggaemo 177
Zeus 151
Leta 108
PianO 93
[ Show more ]
Mind 90
Stork 68
Aegong 52
Sacsri 38
Sharp 37
sorry 34
Backho 33
soO 27
Free 24
sSak 19
Shinee 18
Dewaltoss 17
Bale 15
ZerO 9
Dota 2
XaKoH 390
BananaSlamJamma271
XcaliburYe176
Fuzer 109
League of Legends
JimRising 447
febbydoto6
Counter-Strike
olofmeister1739
Stewie2K818
x6flipin254
oskar216
Super Smash Bros
Westballz103
Other Games
singsing919
Happy280
SortOf147
ZerO(Twitch)1
Organizations
Other Games
gamesdonequick1023
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 14 non-featured ]
StarCraft 2
• davetesta32
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• LaughNgamezSOOP
• Migwel
• sooper7s
StarCraft: Brood War
• iopq 1
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• lizZardDota288
League of Legends
• Stunt852
Upcoming Events
Sparkling Tuna Cup
18m
WardiTV European League
6h 18m
PiGosaur Monday
14h 18m
OSC
1d 2h
uThermal 2v2 Circuit
1d 6h
The PondCast
2 days
Online Event
2 days
Korean StarCraft League
3 days
CranKy Ducklings
4 days
Online Event
4 days
[ Show More ]
Sparkling Tuna Cup
5 days
Liquipedia Results

Completed

BSL 20 Non-Korean Championship
FEL Cracow 2025
Underdog Cup #2

Ongoing

Copa Latinoamericana 4
Jiahua Invitational
BSL 20 Team Wars
CC Div. A S7
IEM Cologne 2025
FISSURE Playground #1
BLAST.tv Austin Major 2025
ESL Impact League Season 7
IEM Dallas 2025
PGL Astana 2025
Asian Champions League '25

Upcoming

BSL 21 Qualifiers
ASL Season 20: Qualifier #1
ASL Season 20: Qualifier #2
ASL Season 20
CSLPRO Chat StarLAN 3
BSL Season 21
RSL Revival: Season 2
Maestros of the Game
SEL Season 2 Championship
WardiTV Summer 2025
uThermal 2v2 Main Event
HCC Europe
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.