• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EST 04:34
CET 10:34
KST 18:34
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Team Liquid Map Contest #2312[ASL22] Finals Preview: Sweet Victory!12[ASL22] Ro4 Preview: Mirror Mirror6[ASL22] Ro8 Preview: Within Reach5[ASL22] Ro8 Preview: In A Tizzy11
Community News
Weekly Cups (Nov 9-15): Clem and herO take over6Dark completes military service, returns to SC217[BSL23] RO16 Group Stage20Weekly Cups (Nov 2-8): herO back on top?2Weekly Cups (Oct 26 - Nov 1): MaxPax, herO, Solar win0
StarCraft 2
General
Weekly Cups (Nov 9-15): Clem and herO take over SC4ALL: II Indiegogo Campaign Announcement No more SC2 streamers on team liquid? Team Liquid Map Contest #23 StarCraft open world shooter announced at BlizzCon
Tourneys
RSL goes to London! 2026 Offline Finals Nov 21-22 soO & FanTaSy return! SC2 Kevin Scrim 4v4 (Nov 16) Sparkling Tuna Cup - Weekly Open Tournament Sea Duckling Open (Global, Bronze-Diamond) Dark returns! GSL CK #7 4v4 Team Battle (Nov 19)
Strategy
[H] ZvP Mid-Late Game: Stalkers Collossi HT
Custom Maps
[G] How to playtest arcade maps Starcraft 2 Advance [D] the control group Simple Questions/Answers
External Content
Mutation # 552 Secret Storm The PondCast: SC2 News & Results Mutation # 551 Robotic Revival Mutation # 550 Graveyard Shift
Brood War
General
XUN appreciation thread List of top players active on ShieldBattery Potentially helpful Shield Battery feedback. People still play BW? SC4ALL: II Indiegogo Campaign Announcement
Tourneys
2v2v2v2 Tournament Stage 2: Players [BSL23] Ro16 Group B - Saturday 21:00 CET KCM Race Survival 2026 Season 4 SC1 Kevin Scrim hosted by SOOP (Nov 18-19)
Strategy
Pluto's TvP 5Marine 2Medic Push Simple Questions, Simple Answers Infested Terran strategies in 2026 Nuke strategy worked in K-League 2026-11-09
Other Games
General Games
Nintendo Switch Thread The PlayStation 5 Stormgate/Frost Giant Megathread Warcraft III: The Frozen Throne Free Space RTS Game, optimised f. Phone/Tablet etc
Dota 2
League of Legends
[TL LoL EUW IHs] Teemo shall perish
Heroes of the Storm
Heroes of the Storm 2.0
Hearthstone
Deck construction bug
TL Mafia
TL Mafia Community Thread
Community
General
Russo-Ukrainian War Thread Things Aren’t Peaceful in Palestine US Politics Mega-thread The Games Industry And ATVI Trading/Investing Thread
Fan Clubs
Fan Club Resource Thread Reynor Fan Club The Flash Fan Club
Media & Entertainment
Movie Discussion! Anime Discussion Thread [Manga] One Piece
Sports
Football (Soccer) Thread TeamLiquid Health and Fitness Initiative For 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List Recent Gifted Posts
Blogs
The time I organised my…
AssyrianKing
Why I built Repalyzer (1.1.…
BlueStar
Innovate or Game Over?
TrAiDoS
ShieldBattery on Mac
Kraekkling
Can Bots Beat Pros?? Starcr…
namkraft
James Bond movies ranking - pa…
Topin
StarCraft improvement
iopq
Socialism Anyone?
GreenHorizons
Customize Sidebar...

Website Feedback

Closed Threads



Active: 12794 users

Lies, Damn Lies, and Statistics

Forum Index > Closed
Post a Reply
1 2 Next All
suckerfish
Profile Joined April 2010
United States31 Posts
Last Edited: 2010-08-16 21:47:25
August 16 2010 21:11 GMT
#1
At the risk of fanning the flames of an already controversial topic...

I've been playing around a little with Shadowed's new SC2 stats website. If you haven't already seen it, I highly suggest taking a looking at it: http://sc2ranks.com.

In particular, I've been studying the data on the stats tab of the website. It seems to me that over the course of millions of games, the win rate seems fairly well balanced across all three races. No matter whether you filter by region or by player division, the difference between the top-winning race and the bottom-winning race is always < 2%. (the only discrepancy I've been able to find to this is in the Latin America region, where the difference between high/low is < 3%)

I'm no statistician, but a win-rate difference of < 2% between the races sounds like a pretty damn well-balanced game. Then again, given that the sample size is millions of games, maybe 2% is statistically significant.

Now, one piece of information that's missing is the race matchup percentages. Overall, each race seems to be winning the same percentage of games, but there's no information currently on that website to determine if each race matchup shows the same percentage. Hypothetically speaking, it's possible that Zerg wins 100% of the time vs Protoss, and loses 100% of the time vs Terran, but the stats page will still show an overall win rate of 50% for Zerg, which would seem to indicate balance (which is obviously not the case in this example).

Anyway, I guess the point I'm trying to make is that, given the statistics from this website, it's hard for me to reconcile all these reports of race imbalance (even from well-respected players) when the numbers just don't seem to support this.

Am I missing something here? Are the numbers just misleading, and not telling the whole story?

EDIT: Okay, some people have provided me with a good explanation of what I was missing. The long and the short of it is that win percentage isn't a measurement of race balancing or skill level, it's a measurement of how well Blizzard's matchmaking works. Thank you to those who provided a very reasonable answer to my very serious question.

Incidentally, there are stats that support the claims of race imbalance at high-level play: http://www.sc2ranks.com/stats/race/all/1. Note that very highly ranked Terran players are squeezing out both Zerg and Protoss players. If the races were balanced correctly, one would expect to see roughly 30% for each race at every ranking score -- but that's not the case at very high levels.
Kelberot
Profile Joined July 2010
Brazil364 Posts
August 16 2010 21:12 GMT
#2
Am I missing something here? Are the numbers just misleading, and not telling the whole story?

Isn't it obvious?

or do you really believe there's a zerg conspiracy of miserable pro gamers trying to make easy money?
iEchoic
Profile Blog Joined May 2010
United States1776 Posts
August 16 2010 21:14 GMT
#3
The numbers don't indicate any imbalances, and everyone who is impartial will recognize that, people still try to twist it. That's not to say the game is perfectly balanced, but numbers don't support a Z imbalance.

People will say that it's the same because the system tries to keep you at the same win%, but if that were the case with Zerg, there would be less representation in the diamond league than other leagues due to matchmaker pairing up with lower-skilled opponents. This isn't the case.
vileEchoic -- clanvile.com
suckerfish
Profile Joined April 2010
United States31 Posts
August 16 2010 21:14 GMT
#4
Actually, no it's not obvious to me. How is it that, across millions of games, the difference between top and bottom race is < 2%, regardless of region or division?

No, I don't think there's a Zerg conspiracy, but how do you explain the numbers?
Nokarot
Profile Blog Joined April 2010
United States1410 Posts
Last Edited: 2010-08-16 21:24:20
August 16 2010 21:15 GMT
#5
Any chance you can filter that by diamond-league only and run the numbers again? Never used the site so I have no idea.

And yes, I've heard the age old argument that, one, stats don't matter, and two, that diamond-league-play can't be the only factor in selling a game to millions of people to have fun with. I'm just curious is all.

Edit: I'm really bad at math-- I dropped out of high school and I'm an art major, damn it! Can someone explain to me how every race can have a ~55% win ratio? Maybe I'm missing something, but if you average the winning ratio of ALL players in the world and its above 50 (which would be one winner and one loser for each match) then you're missing the statistics for games somehow?

I'm filtering by "all players in north america". If the average win:loss ratio is 55:100, that means that 5% is fucked up somewhere. If 5% is fucked up, I have trouble believing the other 95% is completely accurate :X Unless, of course, my math-badness is not understanding something very basic.

Also, obligatory "stats don't mean a whole lot in regards to balance" comment goes here.
beep beep boop
eNtitY~
Profile Joined January 2007
United States1293 Posts
Last Edited: 2010-08-16 21:16:35
August 16 2010 21:15 GMT
#6
That's not a good basis for this kind of argument.
http://www.starcraftdream.com
suckerfish
Profile Joined April 2010
United States31 Posts
August 16 2010 21:16 GMT
#7
On August 17 2010 06:15 Nokarot wrote:
Any chance you can filter that by diamond-league only and run the numbers again? Never used the site so I have no idea.


Here: http://sc2ranks.com/stats/region/diamond/1/all

You can also limit it to the Top 100 players world wide too: http://sc2ranks.com/stats/region/diamond/1/100
HubertFelix
Profile Joined April 2010
France631 Posts
August 16 2010 21:17 GMT
#8
Don't you understand that the AMM works like that? The average player's ratio is 1win/1lose.
SlowBlink
Profile Joined August 2010
United States102 Posts
August 16 2010 21:17 GMT
#9
In other news, matchmaking works on battlenet 2.0. At least they got something right.
catamorphist
Profile Joined May 2010
United States297 Posts
Last Edited: 2010-08-16 21:20:48
August 16 2010 21:17 GMT
#10
On August 17 2010 06:12 Kelberot wrote:
Show nested quote +
Am I missing something here? Are the numbers just misleading, and not telling the whole story?

Isn't it obvious?

or do you really believe there's a zerg conspiracy of miserable pro gamers trying to make easy money?


What? I mean, seriously, what? What does this post mean?

I think that most people are in agreement that Zerg is OK at mid-diamond and below levels, and claim that there's only an imbalance in pro play. Specifically, the most common complaint seems to be that Terran especially have too many viable strategies against Zerg, and it's hard to reliably scout and defend against all of them, and that's a problem that only shows up at a very high level of play; the level at which you start saying "My opponent can be doing X, Y, or Z, so here's my plan to distinguish between X, Y, and Z and appropriately handle each possibility." At lower levels, just plain execution and mechanics is much more important.

Also, I'm not convinced that the racial statistics found like this are meaningful; if all the Zerg players had poor results, and Terran and Protoss had some good players, some with poor results, then the Zerg players would tend to match up with other Zerg players & with the worse Terran and Protoss players to maintain a reasonable win/loss ratio, right?
http://us.battle.net/sc2/en/profile/281144/1/catamorphist/
MangoTango
Profile Blog Joined June 2010
United States3670 Posts
August 16 2010 21:19 GMT
#11
2% is going to be statistically significant at n~10m, but as any student of statistics knows, the t-test doesn't say how much the populations are different, just that they are. The differences are minute ate best.

Then again, this doesn't preclude a T>Z>P>T rock-paper-scissors dynamic, which many people believe is the case.
"One fish, two fish, red fish, BLUE TANK!" - Artosis
Sadistx
Profile Blog Joined February 2009
Zimbabwe5568 Posts
August 16 2010 21:20 GMT
#12
It's been mentioned several times already that the ladder is designed to have ~50% win rate among all players. However those stats are meaningless since balance can only be aptly judged at the very top.
suckerfish
Profile Joined April 2010
United States31 Posts
August 16 2010 21:21 GMT
#13
On August 17 2010 06:17 catamorphist wrote:
I think that most people are in agreement that Zerg is OK at mid-diamond and below levels, and claim that there's only an imbalance in pro play.


But the stats don't even support this claim. If you look at the Top 100 players in each region, the difference is still < 2% for each race: http://sc2ranks.com/stats/region/diamond/1/100
rextyrann
Profile Joined July 2009
Germany41 Posts
August 16 2010 21:23 GMT
#14
another one going on about the winratios without regarding the mm...

again.

you could just read a bit in the forum and save yourself the work of making a new thread. close plz...
Attris
Profile Joined September 2009
United States175 Posts
August 16 2010 21:23 GMT
#15
No really, everyone needs to keep making more of these posts. I just really don't see enough of them.
Are you serious? |sRs| www.srejects.com
tacrats
Profile Joined July 2010
476 Posts
Last Edited: 2010-08-16 21:23:52
August 16 2010 21:23 GMT
#16
That information is useless and yes you are missing quite a bit.

If anyone thinks that the information on sc2ranks in its current state can provide insight to imbalance is dense.

This has been discussed countless times i suggest you read some other threads before posting another one of the exact same thing.
DTown
Profile Blog Joined April 2010
United States428 Posts
Last Edited: 2010-08-16 21:29:09
August 16 2010 21:24 GMT
#17
On August 17 2010 06:14 iEchoic wrote:
The numbers don't indicate any imbalances, and everyone who is impartial will recognize that, people still try to twist it. That's not to say the game is perfectly balanced, but numbers don't support a Z imbalance.

People will say that it's the same because the system tries to keep you at the same win%, but if that were the case with Zerg, there would be less representation in the diamond league than other leagues due to matchmaker pairing up with lower-skilled opponents. This isn't the case.


This is exactly what is happening. The diamond league is huge, and there is much variation of player skill within the diamond league. Plenty of zerg's can get into diamond league, because doing so is not particularly difficult. It could still be--and I firmly believe is--the case that the close win-rate percentages are strictly proof that Blizzard's AMM system is working as intended. Zerg players' win-rates are similar to those of other races because on the margin, zerg players in each division are being matched up with "less skilled" terrans, for example. All of this can happen within each division without statistically skewing the race representation stats too far one way or the other, and this would certainly enable (by a large margin) enough margin of error to cast a high degree of suspicion on the validity of conclusions drawn from win-rate percentage comparisons.

tl;dr Seriously, please stop trying to use this data as statistical evidence in support of either argument (Terran OP/Terran not OP), it is just plain not a valid source of data.

edit: typo
StaR_Robo
Profile Joined May 2010
Australia229 Posts
Last Edited: 2010-08-16 21:27:27
August 16 2010 21:24 GMT
#18
[image loading]

That is the win ratio summary for diamond league. I have the analysis cut by a slightly different level of detail on Sanctuary Stats. Actually shows a higher average ratio and probably not much more variance.

Don't forget that the only race info we have is favourite race so the matching of that to games played by actual race is not exact. If you play 99 games as zerg and 100 as protoss you will be shown as protoss for your favourite race
Working to spread StarCraft II through http://rts-sanctuary.com - replays, stats, streams and more ...
Chriamon
Profile Joined April 2010
United States886 Posts
Last Edited: 2010-08-16 21:27:02
August 16 2010 21:25 GMT
#19
On August 17 2010 06:14 iEchoic wrote:
[...] if that were the case with Zerg, there would be less representation in the diamond league than other leagues due to matchmaker pairing up with lower-skilled opponents. This isn't the case.

That doesn't really make sense to me. How can you just outright say, 'this is what we would see' when there are so many variables. Lets say it were the case, you can clearly see that there are a lot less Zs overall, perhaps the only ones who stick with Z are just much better at it. Or perhaps there would be more representation in the other leagues than diamond, its just that the majority of that 'representation' has now switched to a different race. Basically, the idea that win rates are relatively even because of the matchmaking system, I would say is true. This supports niether imbalance nor balance, it simply supports the fact that the matchmaking system works. If Z were imbalanced, there are other stats to look at, win rate wouldn't be the best thing to look at.

Simply look at the win rate of random. Ooooh look at that! Its the same as the other 3 races! The Random players must be just as good as players of the other 3 races!
http://us.battle.net/sc2/en/profile/274906/1/Blaze/
SlowBlink
Profile Joined August 2010
United States102 Posts
August 16 2010 21:26 GMT
#20
On August 17 2010 06:21 suckerfish wrote:
Show nested quote +
On August 17 2010 06:17 catamorphist wrote:
I think that most people are in agreement that Zerg is OK at mid-diamond and below levels, and claim that there's only an imbalance in pro play.


But the stats don't even support this claim. If you look at the Top 100 players in each region, the difference is still < 2% for each race: http://sc2ranks.com/stats/region/diamond/1/100


This whole premise is flawed. What you're trying to say is that since zerg players win 50% of the time, there is no imbalance for zerg. What you don't take into account is the fact that Blizzard's matchmaking system is specifically designed so that you come out with a 50% win/loss record. Battle net will match you up against a player of equal skill so to speak, and reevaluate your skill based on whether you win or lose. With this mechanic you can have pro level zergs getting matched with plat/gold level terrans, simply because the zerg player is losing more to higher level terrans. Then when they beat the lower level players, it balances out their win/loss to 50%.

tl;dr- all this proves is that battlenet matchmaking actually works.
1 2 Next All
Please log in or register to reply.
Live Events Refresh
Next event in 3h 26m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
ProTech82
ByuN 39
StarCraft: Brood War
Britney 23067
Bisu 774
Horang2 446
Hyuk 315
BeSt 276
Zeus 235
actioN 230
Mind 67
Shinee 62
PianO 49
[ Show more ]
Hm[arnc] 33
EffOrt 22
yabsab 20
ZergMaN 10
Sacsri 8
sOs 3
Super Smash Bros
Mew2King26
Other Games
summit1g12187
singsing1405
JimRising 413
Fuzer 158
Organizations
StarCraft: Brood War
UltimateBattle 43
lovetv 10
[ Show 9 non-featured ]
StarCraft 2
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
League of Legends
• Stunt456
Upcoming Events
RSL Revival
3h 26m
Clem vs Serral
herO vs Rogue
OSC
3h 26m
IPSL
7h 26m
Ret vs ggnore13
nOmaD vs Aether
BSL
10h 26m
Bonyth vs Doodle
Kyrie vs Jimin
Replay Cast
13h 26m
WardiTV Weekly
1d 2h
Kung Fu Cup
2 days
Solar vs Classic
ByuN vs SHIN
PiGosaur Cup
2 days
The PondCast
4 days
KCM Race Survival
4 days
Liquipedia Results

Completed

Proleague 2026-11-17
Blizzard Classic Cup 2026
HCC Season 3

Ongoing

Acropolis #5
KCM Race Survival 2026 Season 4
International ShieldBattery League
BSL Season 23
IPSL Winter 2026-27
RSL Offline Finals
Calamity Cup Div. A Season 8
Underdog Cup 2026 Div 2-3
Stake Ranked Episode 6
BLAST Rivals Fall 2026
IEM Beijing 2026
PGL Masters Bucharest 2026
Stake Ranked Episode 5
1win Private Club #2
Thunderpick World Champ. '26
ESL Pro League Season 24
Stake Ranked Episode 4
1win Private Club #1
Logitech G Play Connect 2026
SL StarSeries Fall 2026
FISSURE Playground #3

Upcoming

CSL Season 23: Qualifier 1
Sector 591
YSL S4
SC4ALL II: Brood War
CSL 2026 Winter (S23) - 3v3
CSL 2026 Winter (S23)
NBSL 2026 Xiamen LAN
HSC XXX
Stellar Fest 2: Lunar Cup
StarCraft2 Weekly Open Tournament 2026 Grand Finals
SC4ALL II: StarCraft II
Kung Fu Cup 2026 Grand Finals
IEM Kraków 2027
PGL Bucharest 2027
BLAST Bounty Winter 2027
PGL Major Singapore 2026
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.