• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 07:07
CEST 13:07
KST 20:07
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Code S Season 1 - RO8 Preview3[ASL21] Ro8 Preview Pt2: Progenitors8Code S Season 1 - RO12 Group A: Rogue, Percival, Solar, Zoun13[ASL21] Ro8 Preview Pt1: Inheritors16[ASL21] Ro16 Preview Pt2: All Star10
Community News
Maestros of The Game 2 announcement and schedule !7Weekly Cups (April 27-May 4): Clem takes triple0RSL Revival: Season 5 - Qualifiers and Main Event12Code S Season 1 (2026) - RO12 Results12026 GSL Season 1 Qualifiers25
StarCraft 2
General
Code S Season 1 - RO8 Preview Behind the Blue - Team Liquid History Book Weekly Cups (April 27-May 4): Clem takes triple Blizzard Classic Cup @ BlizzCon 2026 - $100k prize pool Code S Season 1 (2026) - RO12 Results
Tourneys
Maestros of The Game 2 announcement and schedule ! GSL Code S Season 1 (2026) Sea Duckling Open (Global, Bronze-Diamond) RSL Revival: Season 5 - Qualifiers and Main Event Sparkling Tuna Cup - Weekly Open Tournament
Strategy
Custom Maps
[D]RTS in all its shapes and glory <3 [A] Nemrods 1/4 players
External Content
Mutation # 524 Death and Taxes The PondCast: SC2 News & Results Mutation # 523 Firewall Mutation # 522 Flip My Base
Brood War
General
Do we have a pimpest plays list? BGH Auto Balance -> http://bghmmr.eu/ (Spoiler) Asl ro8 D winner interview BW General Discussion AI Question
Tourneys
[ASL21] Ro8 Day 4 Escore Tournament StarCraft Season 2 Small VOD Thread 2.0 [BSL22] RO16 Group Stage - 02 - 10 May
Strategy
Simple Questions, Simple Answers Fighting Spirit mining rates What's the deal with APM & what's its true value Any training maps people recommend?
Other Games
General Games
Stormgate/Frost Giant Megathread Path of Exile Nintendo Switch Thread OutLive 25 (RTS Game) Dawn of War IV
Dota 2
The Story of Wings Gaming
League of Legends
G2 just beat GenG in First stand
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Deck construction bug Heroes of StarCraft mini-set
TL Mafia
Vanilla Mini Mafia Mafia Game Mode Feedback/Ideas TL Mafia Community Thread Five o'clock TL Mafia
Community
General
Canadian Politics Mega-thread European Politico-economics QA Mega-thread US Politics Mega-thread The Letting Off Steam Thread Russo-Ukrainian War Thread
Fan Clubs
The IdrA Fan Club
Media & Entertainment
Anime Discussion Thread [Manga] One Piece [Req][Books] Good Fantasy/SciFi books
Sports
2024 - 2026 Football Thread McBoner: A hockey love story Formula 1 Discussion
World Cup 2022
Tech Support
streaming software Strange computer issues (software) [G] How to Block Livestream Ads
TL Community
The Automated Ban List
Blogs
How EEG Data Can Predict Gam…
TrAiDoS
ramps on octagon
StaticNine
Funny Nicknames
LUCKY_NOOB
Customize Sidebar...

Website Feedback

Closed Threads



Active: 1327 users

Balancing sc2

Blogs > darmousseh
Post a Reply
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 22:29 GMT
#1
You are the creator of a game called black and white. All players have a choice of playing either black or white during the game and its a 1 on 1 game. You are the creator of the game and you have designed it such that black has a tiny disadvantage against white. During a testing period of matchups where players had to switch between black and white between each game over 1000 games you noticed that white wins 55% of the time. This concerns you a little, but you frankly don't care.


Now you release the game to the general public. Each player picks the color they want to be. You notice that more people are playing black 0%, but that the top 200 is 65% black and 35% white. This gets you thinking that black is actually overpowered, except that you don't know that on average, player that play black are about 70 points more skilled than players that play white. Since you don't know this information you try to extrapolate it, except, that you invented a matchmaking algorithm where each player plays games in such a way that their win percentage is always around 50% and at the latest tournament a white player won.



So what information can we gather? The answer? Nothing, it is impossible to know that white is actually overpowered. The information mathematically that you need to determine this is 1. That players who play black are on average 70 points more skilled 2. Two equally skilled players in a black/white game will favor white 55% of the time.

Is there a way to determine 2? Yes, you can test matchups of evenly skilled players who are forced to learn to play as white and as black.

Is there a way to determine 1? No, The rating system being used is a combination of player skill and environment. If the environment is unfavorable this will be reflected as rating. Can we approximate 1? Possibly, if you make a crazy assumption such as that the skill of a player is 95% skill and 5% color. Is there a systematic way of determining this ratio? Yes, if a group of players learned how to play both black and white equally, then you can exprapolate this information.


Why did i post this? Because 1 and 2 are impossible to gather in sc2. It is possible that zerg is actually OP, maybe protoss is OP, unless we have a lot of recent information from similarly skilled players (who have enough games as each race) otherwise we cannot determine either 1 or 2.

When blizzard posts information about win/loss ratio of different matchups what does it mean? It doesn't mean anything. Its possible that player who play terran are simply more skilled on average than zerg, it's possible that zerg adds 50 points to a players skill, but the skill of the players playing it on average lowers it. Maybe cool is an example where he is the same skill as a terran, but that playing zerg gives him an advantage.

The answer is without equal parameters or conditions, all statistics are meaningless.


If you come up with a way for blizzard to get the information about balance without all of the neccesary inforamtion that i just described, please post it and then write a thesis and publish it please.

Also please use probability theory to explain your ideas or at least talk about the minimum information needed.

Developer for http://mtgfiddle.com
Tabbris
Profile Blog Joined June 2010
Bangladesh2839 Posts
Last Edited: 2010-10-08 22:40:47
October 08 2010 22:40 GMT
#2
I think this post is good enough to not be post in blogs . I agree. Blizzard has a very very hard job
ideadude
Profile Joined April 2010
United States7 Posts
Last Edited: 2010-10-08 23:07:42
October 08 2010 23:06 GMT
#3
Great analysis. Thanks.

Couldn't the game company recreate (in a sense) the initial experiment where people were (a) forced to play both sides against (b) random opponents? (When the initial 55% win ratio was discovered.)

If you make 1-in-50 games played match people randomly instead of using the match-making algorithm, you would get (b) above.

If you chose a random subset of these games across all races, wouldn't that be the same as (a)?

You would be able to say a random Black paired up against a random White wins x% of the time. This removes all skill from the equation since you didn't match them based on the calculated skill.

The one thing this experiment would miss is the assumption that equally skilled players are as likely to choose Black vs. White. (Maybe unskilled players are drawn towards White since the game released with the White campaign.)

How would you remove this affect? Maybe you grab randomly from people who have played at least 50 games? Maybe you limit things to people who have played White and Black a certain number of times? Not sure.
Patriot.dlk
Profile Blog Joined October 2004
Sweden5462 Posts
Last Edited: 2010-10-08 23:19:03
October 08 2010 23:17 GMT
#4
They need to focus on getting each race equally played, but how do you overcome a big influence of terrans and protoss due to those races being featured in the single player?

No idea. But I would really try to get them equally played and then collect a lot of different data. How many #1 guys of each race in their leagues, top 500, statistically what race wins most on [insert map], compare with big tournament results etc etc.

Going at this trying to get a smart algorithm in the works is just not how you perfom data mining, you need to look at it in EVERY possible perspective you can think of.

What you suggest here is basic probability and it's miles away from being useful
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 23:54 GMT
#5
I have had bad luck posting stuff in starcraft 2 general. Usually some moderator comes by and says "This is already being discussed here" or "This should be a blog post" so i usually post here.
Developer for http://mtgfiddle.com
Kaptein[konijn]
Profile Joined August 2005
Netherlands110 Posts
October 09 2010 08:44 GMT
#6
I agree, you can't make meaningful balance-related statements based on statistics in the current match making system. People make a lot of invalid implicit or explicit assumptions when they believe they can.
Please log in or register to reply.
Live Events Refresh
WardiTV Invitational
11:00
Wardi Spring Cup
Zoun vs Ryung
Lambo vs ShoWTimE
IntoTheiNu 200
WardiTV158
Rex43
TKL 41
Ryung 30
LiquipediaDiscussion
The PondCast
10:00
Episode 92
CranKy Ducklings44
LiquipediaDiscussion
Escore
10:00
Week 6
escodisco1759
LiquipediaDiscussion
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
ProTech143
Rex 39
Ryung 30
TKL 25
StarCraft: Brood War
Calm 4492
Sea 3389
Horang2 624
Hyuk 388
Mini 268
EffOrt 261
BeSt 227
Killer 225
actioN 219
Light 210
[ Show more ]
Soma 179
Zeus 122
Soulkey 122
ZerO 122
ggaemo 111
Pusan 102
Dewaltoss 85
Hyun 76
ToSsGirL 74
hero 69
Rush 65
Sharp 50
Mong 48
Backho 45
Barracks 39
sorry 38
Hm[arnc] 36
910 35
Shine 32
Free 31
Sacsri 29
[sc1f]eonzerg 22
scan(afreeca) 21
soO 20
Shinee 20
ajuk12(nOOB) 13
GoRush 13
yabsab 12
Bale 11
Noble 9
Sea.KH 6
Terrorterran 3
IntoTheRainbow 2
Dota 2
monkeys_forever176
League of Legends
Reynor45
Counter-Strike
zeus850
allub210
edward108
Other Games
gofns13006
singsing1744
B2W.Neo936
DeMusliM319
Lowko244
KnowMe154
Mew2King64
NeuroSwarm48
ZerO(Twitch)15
Organizations
Other Games
gamesdonequick1176
StarCraft: Brood War
lovetv 7
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
[ Show 18 non-featured ]
StarCraft 2
• StrangeGG 73
• CranKy Ducklings SOOP70
• LUISG 41
• Kozan
• sooper7s
• Migwel
• LaughNgamezSOOP
• IndyKCrew
• intothetv
• AfreecaTV YouTube
StarCraft: Brood War
• iopq 2
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
League of Legends
• Nemesis1636
• TFBlade968
• Stunt487
Other Games
• WagamamaTV338
Upcoming Events
Big Brain Bouts
4h 53m
Fjant vs Bly
Serral vs Shameless
OSC
10h 53m
The PiG Daily
11h 53m
Maru vs Rogue
TBD vs Classic
herO vs Solar
ByuN vs Solar
Replay Cast
12h 53m
CranKy Ducklings
22h 53m
RSL Revival
22h 53m
SHIN vs Bunny
ByuN vs Shameless
WardiTV Invitational
23h 53m
Krystianer vs TriGGeR
Cure vs Rogue
SC Evo League
1d 1h
uThermal 2v2 Circuit
1d 3h
BSL
1d 7h
Artosis vs TerrOr
spx vs StRyKeR
[ Show More ]
Replay Cast
1d 12h
Sparkling Tuna Cup
1d 22h
RSL Revival
1d 22h
Cure vs Zoun
Clem vs Lambo
WardiTV Invitational
1d 23h
BSL
2 days
Dewalt vs DragOn
Aether vs Jimin
GSL
2 days
Afreeca Starleague
2 days
Soma vs Leta
Wardi Open
3 days
Monday Night Weeklies
3 days
OSC
3 days
CranKy Ducklings
3 days
Afreeca Starleague
3 days
Light vs Flash
Replay Cast
4 days
Replay Cast
5 days
The PondCast
5 days
Replay Cast
6 days
RSL Revival
6 days
Liquipedia Results

Completed

Proleague 2026-05-05
WardiTV TLMC #16
Nations Cup 2026

Ongoing

BSL Season 22
ASL Season 21
CSL 2026 SPRING (S20)
IPSL Spring 2026
KCM Race Survival 2026 Season 2
Acropolis #4
Escore Tournament S2: W6
SCTL 2026 Spring
RSL Revival: Season 5
2026 GSL S1
BLAST Rivals Spring 2026
IEM Rio 2026
PGL Bucharest 2026
Stake Ranked Episode 1
BLAST Open Spring 2026
ESL Pro League S23 Finals
ESL Pro League S23 Stage 1&2

Upcoming

KK 2v2 League Season 1
BSL 22 Non-Korean Championship
YSL S3
Escore Tournament S2: W7
Escore Tournament S2: W8
CSLAN 4
Kung Fu Cup 2026 Grand Finals
HSC XXIX
uThermal 2v2 2026 Main Event
Maestros of the Game 2
2026 GSL S2
BLAST Bounty Summer 2026: Closed Qualifier
Stake Ranked Episode 3
XSE Pro League 2026
IEM Cologne Major 2026
Stake Ranked Episode 2
CS Asia Championships 2026
IEM Atlanta 2026
Asian Champions League 2026
PGL Astana 2026
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.