• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EST 13:42
CET 19:42
KST 03:42
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
RSL Revival - 2025 Season Finals Preview8RSL Season 3 - Playoffs Preview0RSL Season 3 - RO16 Groups C & D Preview0RSL Season 3 - RO16 Groups A & B Preview2TL.net Map Contest #21: Winners12
Community News
ComeBackTV's documentary on Byun's Career !10Weekly Cups (Dec 8-14): MaxPax, Clem, Cure win4Weekly Cups (Dec 1-7): Clem doubles, Solar gets over the hump1Weekly Cups (Nov 24-30): MaxPax, Clem, herO win2BGE Stara Zagora 2026 announced15
StarCraft 2
General
ComeBackTV's documentary on Byun's Career ! Micro Lags When Playing SC2? When will we find out if there are more tournament Weekly Cups (Dec 8-14): MaxPax, Clem, Cure win RSL Revival - 2025 Season Finals Preview
Tourneys
Sparkling Tuna Cup - Weekly Open Tournament $100 Prize Pool - Winter Warp Gate Masters Showdow $5,000+ WardiTV 2025 Championship Winter Warp Gate Amateur Showdown #1 RSL Offline Finals Info - Dec 13 and 14!
Strategy
Custom Maps
Map Editor closed ?
External Content
Mutation # 505 Rise From Ashes Mutation # 504 Retribution Mutation # 503 Fowl Play Mutation # 502 Negative Reinforcement
Brood War
General
Klaucher discontinued / in-game color settings Anyone remember me from 2000s Bnet EAST server? BGH Auto Balance -> http://bghmmr.eu/ How Rain Became ProGamer in Just 3 Months FlaSh on: Biggest Problem With SnOw's Playstyle
Tourneys
[BSL21] LB QuarterFinals - Sunday 21:00 CET Small VOD Thread 2.0 [Megathread] Daily Proleagues [BSL21] WB SEMIFINALS - Saturday 21:00 CET
Strategy
Simple Questions, Simple Answers Game Theory for Starcraft Current Meta Fighting Spirit mining rates
Other Games
General Games
Stormgate/Frost Giant Megathread General RTS Discussion Thread Nintendo Switch Thread Mechabellum PC Games Sales Thread
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Deck construction bug Heroes of StarCraft mini-set
TL Mafia
Mafia Game Mode Feedback/Ideas Survivor II: The Amazon Sengoku Mafia TL Mafia Community Thread
Community
General
US Politics Mega-thread The Games Industry And ATVI Russo-Ukrainian War Thread Things Aren’t Peaceful in Palestine YouTube Thread
Fan Clubs
White-Ra Fan Club
Media & Entertainment
Anime Discussion Thread [Manga] One Piece Movie Discussion!
Sports
2024 - 2026 Football Thread Formula 1 Discussion
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
TL+ Announced Where to ask questions and add stream?
Blogs
The (Hidden) Drug Problem in…
TrAiDoS
I decided to write a webnov…
DjKniteX
James Bond movies ranking - pa…
Topin
Thanks for the RSL
Hildegard
Customize Sidebar...

Website Feedback

Closed Threads



Active: 2091 users

Balancing sc2

Blogs > darmousseh
Post a Reply
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 22:29 GMT
#1
You are the creator of a game called black and white. All players have a choice of playing either black or white during the game and its a 1 on 1 game. You are the creator of the game and you have designed it such that black has a tiny disadvantage against white. During a testing period of matchups where players had to switch between black and white between each game over 1000 games you noticed that white wins 55% of the time. This concerns you a little, but you frankly don't care.


Now you release the game to the general public. Each player picks the color they want to be. You notice that more people are playing black 0%, but that the top 200 is 65% black and 35% white. This gets you thinking that black is actually overpowered, except that you don't know that on average, player that play black are about 70 points more skilled than players that play white. Since you don't know this information you try to extrapolate it, except, that you invented a matchmaking algorithm where each player plays games in such a way that their win percentage is always around 50% and at the latest tournament a white player won.



So what information can we gather? The answer? Nothing, it is impossible to know that white is actually overpowered. The information mathematically that you need to determine this is 1. That players who play black are on average 70 points more skilled 2. Two equally skilled players in a black/white game will favor white 55% of the time.

Is there a way to determine 2? Yes, you can test matchups of evenly skilled players who are forced to learn to play as white and as black.

Is there a way to determine 1? No, The rating system being used is a combination of player skill and environment. If the environment is unfavorable this will be reflected as rating. Can we approximate 1? Possibly, if you make a crazy assumption such as that the skill of a player is 95% skill and 5% color. Is there a systematic way of determining this ratio? Yes, if a group of players learned how to play both black and white equally, then you can exprapolate this information.


Why did i post this? Because 1 and 2 are impossible to gather in sc2. It is possible that zerg is actually OP, maybe protoss is OP, unless we have a lot of recent information from similarly skilled players (who have enough games as each race) otherwise we cannot determine either 1 or 2.

When blizzard posts information about win/loss ratio of different matchups what does it mean? It doesn't mean anything. Its possible that player who play terran are simply more skilled on average than zerg, it's possible that zerg adds 50 points to a players skill, but the skill of the players playing it on average lowers it. Maybe cool is an example where he is the same skill as a terran, but that playing zerg gives him an advantage.

The answer is without equal parameters or conditions, all statistics are meaningless.


If you come up with a way for blizzard to get the information about balance without all of the neccesary inforamtion that i just described, please post it and then write a thesis and publish it please.

Also please use probability theory to explain your ideas or at least talk about the minimum information needed.

Developer for http://mtgfiddle.com
Tabbris
Profile Blog Joined June 2010
Bangladesh2839 Posts
Last Edited: 2010-10-08 22:40:47
October 08 2010 22:40 GMT
#2
I think this post is good enough to not be post in blogs . I agree. Blizzard has a very very hard job
ideadude
Profile Joined April 2010
United States7 Posts
Last Edited: 2010-10-08 23:07:42
October 08 2010 23:06 GMT
#3
Great analysis. Thanks.

Couldn't the game company recreate (in a sense) the initial experiment where people were (a) forced to play both sides against (b) random opponents? (When the initial 55% win ratio was discovered.)

If you make 1-in-50 games played match people randomly instead of using the match-making algorithm, you would get (b) above.

If you chose a random subset of these games across all races, wouldn't that be the same as (a)?

You would be able to say a random Black paired up against a random White wins x% of the time. This removes all skill from the equation since you didn't match them based on the calculated skill.

The one thing this experiment would miss is the assumption that equally skilled players are as likely to choose Black vs. White. (Maybe unskilled players are drawn towards White since the game released with the White campaign.)

How would you remove this affect? Maybe you grab randomly from people who have played at least 50 games? Maybe you limit things to people who have played White and Black a certain number of times? Not sure.
Patriot.dlk
Profile Blog Joined October 2004
Sweden5462 Posts
Last Edited: 2010-10-08 23:19:03
October 08 2010 23:17 GMT
#4
They need to focus on getting each race equally played, but how do you overcome a big influence of terrans and protoss due to those races being featured in the single player?

No idea. But I would really try to get them equally played and then collect a lot of different data. How many #1 guys of each race in their leagues, top 500, statistically what race wins most on [insert map], compare with big tournament results etc etc.

Going at this trying to get a smart algorithm in the works is just not how you perfom data mining, you need to look at it in EVERY possible perspective you can think of.

What you suggest here is basic probability and it's miles away from being useful
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 23:54 GMT
#5
I have had bad luck posting stuff in starcraft 2 general. Usually some moderator comes by and says "This is already being discussed here" or "This should be a blog post" so i usually post here.
Developer for http://mtgfiddle.com
Kaptein[konijn]
Profile Joined August 2005
Netherlands110 Posts
October 09 2010 08:44 GMT
#6
I agree, you can't make meaningful balance-related statements based on statistics in the current match making system. People make a lot of invalid implicit or explicit assumptions when they believe they can.
Please log in or register to reply.
Live Events Refresh
Ladder Legends
17:00
WWG Masters Showdown
SteadfastSC84
Liquipedia
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
White-Ra 296
ProTech134
SteadfastSC 84
SKillous 79
BRAT_OK 70
DivinesiaTV 25
MindelVK 21
trigger 17
StarCraft: Brood War
Calm 2935
Shuttle 507
Light 248
Mini 103
Dewaltoss 103
firebathero 99
Hyun 99
hero 78
ggaemo 63
yabsab 35
[ Show more ]
910 28
soO 19
Killer 15
HiyA 9
Dota 2
Gorgc7317
singsing3436
qojqva2527
Counter-Strike
pashabiceps1316
fl0m879
chrisJcsgo46
Heroes of the Storm
Khaldor712
Liquid`Hasu509
Other Games
FrodaN1320
Beastyqt634
B2W.Neo517
KnowMe247
mouzStarbuck220
ToD216
ArmadaUGS178
Mew2King100
QueenE81
Organizations
Other Games
PGL1218
gamesdonequick641
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 18 non-featured ]
StarCraft 2
• HeavenSC 33
• StrangeGG 32
• Adnapsc2 8
• Reevou 7
• Kozan
• Migwel
• AfreecaTV YouTube
• intothetv
• sooper7s
• IndyKCrew
• LaughNgamezSOOP
StarCraft: Brood War
• STPLYoutube
• ZZZeroYoutube
• BSLYoutube
Dota 2
• WagamamaTV226
• HappyZerGling60
Other Games
• imaqtpie859
• Shiphtur179
Upcoming Events
BSL 21
1h 18m
StRyKeR vs TBD
Bonyth vs TBD
Replay Cast
14h 18m
Wardi Open
17h 18m
Monday Night Weeklies
22h 18m
WardiTV Invitational
2 days
Replay Cast
3 days
WardiTV Invitational
3 days
ByuN vs Solar
Clem vs Classic
Cure vs herO
Reynor vs MaxPax
Replay Cast
5 days
Sparkling Tuna Cup
6 days
Liquipedia Results

Completed

Acropolis #4 - TS3
RSL Offline Finals
Kuram Kup

Ongoing

C-Race Season 1
IPSL Winter 2025-26
KCM Race Survival 2025 Season 4
BSL Season 21
Slon Tour Season 2
CSL Season 19: Qualifier 1
WardiTV 2025
META Madness #9
eXTREMESLAND 2025
SL Budapest Major 2025
ESL Impact League Season 8
BLAST Rivals Fall 2025
IEM Chengdu 2025
PGL Masters Bucharest 2025
Thunderpick World Champ.
CS Asia Championships 2025
ESL Pro League S22

Upcoming

CSL Season 19: Qualifier 2
CSL 2025 WINTER (S19)
BSL 21 Non-Korean Championship
Acropolis #4
IPSL Spring 2026
Bellum Gens Elite Stara Zagora 2026
HSC XXVIII
Big Gabe Cup #3
OSC Championship Season 13
Nations Cup 2026
ESL Pro League Season 23
PGL Cluj-Napoca 2026
IEM Kraków 2026
BLAST Bounty Winter 2026
BLAST Bounty Winter Qual
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.