• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 10:35
CEST 16:35
KST 23:35
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[ASL22] Ro8 Preview: Within Reach5[ASL22] Ro8 Preview: In A Tizzy11[ASL22] Ro16 Preview: Holy Diver5[ASL22] Ro16 Preview: Rough Waters10[ASL22] Ro24 Preview: Siren's Call8
Community News
Weekly Cups (Sept 21-27): herO and ByuN double2Weekly Cups (Sep 13-20): herO scores triple3BSL Season 2313Weekly Cups (Sep 7-12): SHIN, ByuN, MaxPax double down1StarCraft open world shooter announced at BlizzCon111
StarCraft 2
General
StarCraft open world shooter announced at BlizzCon Weekly Cups (Sept 21-27): herO and ByuN double Recent Patches and the Future Stellar Fest 1 Replay Pack Balance hotfix patch 5.0.16b (July 16)
Tourneys
Stellar Fest TWO the Moon (Dec 16-20) 2026 GSTL Grand Finals SC2 INu's Battles#21 [ 3-Days tournament ] ScienceCraft (October 24-25) - Live Event Sparkling Tuna Cup - Weekly Open Tournament
Strategy
[H] ZvP Mid-Late Game: Stalkers Collossi HT
Custom Maps
[M] (2) Sweltering Sands [M] (2) Frigid Storage
External Content
The PondCast: SC2 News & Results Mutation # 545 And Drops and Rifts Mutation # 544 Double Trouble Mutation # 543 Enhanced Defenses
Brood War
General
Bot on ladder Where can I find Flash replays that work? a Announcement on the JEDI Ringing Official StarCraft website teases new content ahead of BlizzCon? BW General Discussion
Tourneys
[Megathread] Daily Proleagues [ASL22] Ro8 Day 3 [ASL22] Ro8 Day 4 [ASL22] Ro8 Day 2
Strategy
Cliff Jump Revisited (1 in a 1000 strategy) Replay Review Process - What do you do? Simple Questions, Simple Answers Odyssey Mineral Stack Saturation
Other Games
General Games
General RTS Discussion Thread Warcraft III: The Frozen Throne Stormgate/Frost Giant Megathread Total Annihilation Zero Nintendo Switch Thread
Dota 2
Dota 2 Champions League Season 3 Begins April 25! Official 'what is Dota anymore' discussion
League of Legends
[TL LoL EUW IHs] Teemo shall perish
Heroes of the Storm
Heroes of the Storm 2.0
Hearthstone
Deck construction bug
TL Mafia
TL Mafia Community Thread
Community
General
Things Aren’t Peaceful in Palestine US Politics Mega-thread All you football fans (soccer)! Russo-Ukrainian War Thread Artificial Intelligence Thread
Fan Clubs
MarineLorD Fan Club The Creator Fan Club The ShoWTimE Fan Club
Media & Entertainment
Movie Discussion! [Manga] One Piece Diablo Animated Series on Netflix
Sports
Football (Soccer) Thread MLB/Baseball 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Recent Gifted Posts
Blogs
Violent-Cooperative Play and…
TrAiDoS
38 yo Retired SWE loo…
PurE)Rabbit-SF
Can Bots Beat Pros?? Starcr…
namkraft
[meme] I finally understa…
LUCKY_NOOB
Regacy Esports:Our Goa…
regacyesports
Customize Sidebar...

Website Feedback

Closed Threads



Active: 9277 users

Balancing sc2

Blogs > darmousseh
Post a Reply
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 22:29 GMT
#1
You are the creator of a game called black and white. All players have a choice of playing either black or white during the game and its a 1 on 1 game. You are the creator of the game and you have designed it such that black has a tiny disadvantage against white. During a testing period of matchups where players had to switch between black and white between each game over 1000 games you noticed that white wins 55% of the time. This concerns you a little, but you frankly don't care.


Now you release the game to the general public. Each player picks the color they want to be. You notice that more people are playing black 0%, but that the top 200 is 65% black and 35% white. This gets you thinking that black is actually overpowered, except that you don't know that on average, player that play black are about 70 points more skilled than players that play white. Since you don't know this information you try to extrapolate it, except, that you invented a matchmaking algorithm where each player plays games in such a way that their win percentage is always around 50% and at the latest tournament a white player won.



So what information can we gather? The answer? Nothing, it is impossible to know that white is actually overpowered. The information mathematically that you need to determine this is 1. That players who play black are on average 70 points more skilled 2. Two equally skilled players in a black/white game will favor white 55% of the time.

Is there a way to determine 2? Yes, you can test matchups of evenly skilled players who are forced to learn to play as white and as black.

Is there a way to determine 1? No, The rating system being used is a combination of player skill and environment. If the environment is unfavorable this will be reflected as rating. Can we approximate 1? Possibly, if you make a crazy assumption such as that the skill of a player is 95% skill and 5% color. Is there a systematic way of determining this ratio? Yes, if a group of players learned how to play both black and white equally, then you can exprapolate this information.


Why did i post this? Because 1 and 2 are impossible to gather in sc2. It is possible that zerg is actually OP, maybe protoss is OP, unless we have a lot of recent information from similarly skilled players (who have enough games as each race) otherwise we cannot determine either 1 or 2.

When blizzard posts information about win/loss ratio of different matchups what does it mean? It doesn't mean anything. Its possible that player who play terran are simply more skilled on average than zerg, it's possible that zerg adds 50 points to a players skill, but the skill of the players playing it on average lowers it. Maybe cool is an example where he is the same skill as a terran, but that playing zerg gives him an advantage.

The answer is without equal parameters or conditions, all statistics are meaningless.


If you come up with a way for blizzard to get the information about balance without all of the neccesary inforamtion that i just described, please post it and then write a thesis and publish it please.

Also please use probability theory to explain your ideas or at least talk about the minimum information needed.

Developer for http://mtgfiddle.com
Tabbris
Profile Blog Joined June 2010
Bangladesh2839 Posts
Last Edited: 2010-10-08 22:40:47
October 08 2010 22:40 GMT
#2
I think this post is good enough to not be post in blogs . I agree. Blizzard has a very very hard job
ideadude
Profile Joined April 2010
United States7 Posts
Last Edited: 2010-10-08 23:07:42
October 08 2010 23:06 GMT
#3
Great analysis. Thanks.

Couldn't the game company recreate (in a sense) the initial experiment where people were (a) forced to play both sides against (b) random opponents? (When the initial 55% win ratio was discovered.)

If you make 1-in-50 games played match people randomly instead of using the match-making algorithm, you would get (b) above.

If you chose a random subset of these games across all races, wouldn't that be the same as (a)?

You would be able to say a random Black paired up against a random White wins x% of the time. This removes all skill from the equation since you didn't match them based on the calculated skill.

The one thing this experiment would miss is the assumption that equally skilled players are as likely to choose Black vs. White. (Maybe unskilled players are drawn towards White since the game released with the White campaign.)

How would you remove this affect? Maybe you grab randomly from people who have played at least 50 games? Maybe you limit things to people who have played White and Black a certain number of times? Not sure.
Patriot.dlk
Profile Blog Joined October 2004
Sweden5462 Posts
Last Edited: 2010-10-08 23:19:03
October 08 2010 23:17 GMT
#4
They need to focus on getting each race equally played, but how do you overcome a big influence of terrans and protoss due to those races being featured in the single player?

No idea. But I would really try to get them equally played and then collect a lot of different data. How many #1 guys of each race in their leagues, top 500, statistically what race wins most on [insert map], compare with big tournament results etc etc.

Going at this trying to get a smart algorithm in the works is just not how you perfom data mining, you need to look at it in EVERY possible perspective you can think of.

What you suggest here is basic probability and it's miles away from being useful
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 23:54 GMT
#5
I have had bad luck posting stuff in starcraft 2 general. Usually some moderator comes by and says "This is already being discussed here" or "This should be a blog post" so i usually post here.
Developer for http://mtgfiddle.com
Kaptein[konijn]
Profile Joined August 2005
Netherlands110 Posts
October 09 2010 08:44 GMT
#6
I agree, you can't make meaningful balance-related statements based on statistics in the current match making system. People make a lot of invalid implicit or explicit assumptions when they believe they can.
Please log in or register to reply.
Live Events Refresh
Stellar Fest
13:00
Stellar Fest 2 The Moon: Qualifier Day 1
IntoTheiNu 684
SteadfastSC370
ComeBackTV 361
Rex136
CosmosSc2 53
EnkiAlexander 41
LiquipediaDiscussion
Kung Fu Cup
11:00
2026 Week 25
LiquipediaDiscussion
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
SteadfastSC 370
Rex 136
ProTech132
CosmosSc2 53
StarCraft: Brood War
Britney 58732
Jaedong 1425
Hyuk 672
Soma 656
EffOrt 622
Horang2 525
Soulkey 480
Mini 473
BeSt 469
Larva 318
[ Show more ]
Last 298
ZerO 283
Rush 272
Stork 250
Snow 201
ggaemo 175
Light 150
Killer 92
Mind 64
hero 61
Pusan 51
Free 49
sorry 40
Shinee 40
Sharp 31
Shine 24
ToSsGirL 22
Bale 22
Terrorterran 18
HiyA 18
yabsab 15
Trap 14
Noble 12
Rock 8
Sacsri 7
Dota 2
Gorgc8260
qojqva1161
Dendi846
Counter-Strike
Fnx 663
markeloff114
x6flipin85
Heroes of the Storm
crisheroes2263
Khaldor2056
Other Games
ArmadaUGS2610
singsing2192
olofmeister1066
B2W.Neo966
hiko882
byalli401
Liquid`VortiX199
Pyrionflax193
KnowMe106
QueenE79
Mew2King75
ZerO(Twitch)14
Railgan11
Organizations
StarCraft: Brood War
UltimateBattle 398
Dota 2
PGL Dota 2 - Main Stream112
[ Show 15 non-featured ]
StarCraft 2
• Berry_CruncH307
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• C_a_k_e 1753
League of Legends
• Nemesis1876
• Jankos1332
• TFBlade731
Other Games
• Shiphtur263
• WagamamaTV195
Upcoming Events
The PondCast
19h 25m
OSC
22h 25m
Stellar Fest
22h 25m
OSC
1d 9h
Stellar Fest
1d 22h
CranKy Ducklings
2 days
Online Event
2 days
FEL
3 days
AI Arena Tournament
3 days
BSL: Ladder Tournament
3 days
[ Show More ]
Sparkling Tuna Cup
3 days
INu's Battles
3 days
herO vs Classic
Percival vs Rogue
BSL Open Qualifier
4 days
BSL Open Qualifier
4 days
Replay Cast
4 days
WardiTV Weekly
4 days
Replay Cast
5 days
INu's Battles
5 days
SHIN vs Cure
ByuN vs Zoun
PiGosaur Cup
6 days
Liquipedia Results

Completed

Proleague 2026-09-27
Blizzard Classic Cup 2026
Calamity Invitational

Ongoing

ASL Season 22
Super Anchor Qualifying S3
CSL 2026 AUTUMN (S22)
Acropolis #5
1win Private Club #1
Logitech G Play Connect 2026
SL StarSeries Fall 2026
FISSURE Playground #3
BLAST Open Fall 2026
Esports World Cup 2026
BLAST Bounty Summer 2026
BLAST Bounty Summer Qual
Stake Ranked Episode 3

Upcoming

Acropolis #5 - GSB
Acropolis #5 - GSC
BSL Season 23
SC4ALL II: Brood War
BSL 23: Non-Korean Championship
HSC XXX
Stellar Fest 2: Lunar Cup
SC4ALL II: StarCraft II
Kung Fu Cup 2026 Grand Finals
RSL Offline Finals
Custodian Cup
Copium Cup
PGL Major Singapore 2026
Stake Ranked Episode 6
BLAST Rivals Fall 2026
IEM Beijing 2026
Stake Ranked Episode 5
PGL Masters Bucharest 2026
1win Private Club #2
Thunderpick World Champ. '26
ESL Pro League Season 24
Stake Ranked Episode 4
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.