• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 20:02
CEST 02:02
KST 09:02
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
RSL Season 1 - Final Week6[ASL19] Finals Recap: Standing Tall12HomeStory Cup 27 - Info & Preview18Classic wins Code S Season 2 (2025)16Code S RO4 & Finals Preview: herO, Rogue, Classic, GuMiho0
Community News
Esports World Cup 2025 - Brackets Revealed10Weekly Cups (July 7-13): Classic continues to roll4Team TLMC #5 - Submission extension3Firefly given lifetime ban by ESIC following match-fixing investigation17$25,000 Streamerzone StarCraft Pro Series announced7
StarCraft 2
General
Who will win EWC 2025? The GOAT ranking of GOAT rankings RSL Revival patreon money discussion thread Weekly Cups (July 7-13): Classic continues to roll Esports World Cup 2025 - Brackets Revealed
Tourneys
FEL Cracov 2025 (July 27) - $8000 live event RSL: Revival, a new crowdfunded tournament series $5,100+ SEL Season 2 Championship (SC: Evo) WardiTV Mondays Sparkling Tuna Cup - Weekly Open Tournament
Strategy
How did i lose this ZvP, whats the proper response Simple Questions Simple Answers
Custom Maps
External Content
Mutation # 482 Wheel of Misfortune Mutation # 481 Fear and Lava Mutation # 480 Moths to the Flame Mutation # 479 Worn Out Welcome
Brood War
General
BGH Auto Balance -> http://bghmmr.eu/ Flash Announces (and Retracts) Hiatus From ASL BW General Discussion Starcraft in widescreen A cwal.gg Extension - Easily keep track of anyone
Tourneys
[Megathread] Daily Proleagues Cosmonarchy Pro Showmatches CSL Xiamen International Invitational [BSL20] Non-Korean Championship 4x BSL + 4x China
Strategy
Simple Questions, Simple Answers I am doing this better than progamers do.
Other Games
General Games
Stormgate/Frost Giant Megathread Path of Exile Nintendo Switch Thread CCLP - Command & Conquer League Project The PlayStation 5
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Vanilla Mini Mafia
Community
General
US Politics Mega-thread Russo-Ukrainian War Thread Stop Killing Games - European Citizens Initiative Summer Games Done Quick 2025! Things Aren’t Peaceful in Palestine
Fan Clubs
SKT1 Classic Fan Club! Maru Fan Club
Media & Entertainment
[Manga] One Piece Movie Discussion! Anime Discussion Thread [\m/] Heavy Metal Thread
Sports
Formula 1 Discussion TeamLiquid Health and Fitness Initiative For 2023 2024 - 2025 Football Thread NBA General Discussion NHL Playoffs 2024
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List
Blogs
Men Take Risks, Women Win Ga…
TrAiDoS
momentary artworks from des…
tankgirl
from making sc maps to makin…
Husyelt
StarCraft improvement
iopq
Trip to the Zoo
micronesia
Customize Sidebar...

Website Feedback

Closed Threads



Active: 660 users

Balancing sc2

Blogs > darmousseh
Post a Reply
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 22:29 GMT
#1
You are the creator of a game called black and white. All players have a choice of playing either black or white during the game and its a 1 on 1 game. You are the creator of the game and you have designed it such that black has a tiny disadvantage against white. During a testing period of matchups where players had to switch between black and white between each game over 1000 games you noticed that white wins 55% of the time. This concerns you a little, but you frankly don't care.


Now you release the game to the general public. Each player picks the color they want to be. You notice that more people are playing black 0%, but that the top 200 is 65% black and 35% white. This gets you thinking that black is actually overpowered, except that you don't know that on average, player that play black are about 70 points more skilled than players that play white. Since you don't know this information you try to extrapolate it, except, that you invented a matchmaking algorithm where each player plays games in such a way that their win percentage is always around 50% and at the latest tournament a white player won.



So what information can we gather? The answer? Nothing, it is impossible to know that white is actually overpowered. The information mathematically that you need to determine this is 1. That players who play black are on average 70 points more skilled 2. Two equally skilled players in a black/white game will favor white 55% of the time.

Is there a way to determine 2? Yes, you can test matchups of evenly skilled players who are forced to learn to play as white and as black.

Is there a way to determine 1? No, The rating system being used is a combination of player skill and environment. If the environment is unfavorable this will be reflected as rating. Can we approximate 1? Possibly, if you make a crazy assumption such as that the skill of a player is 95% skill and 5% color. Is there a systematic way of determining this ratio? Yes, if a group of players learned how to play both black and white equally, then you can exprapolate this information.


Why did i post this? Because 1 and 2 are impossible to gather in sc2. It is possible that zerg is actually OP, maybe protoss is OP, unless we have a lot of recent information from similarly skilled players (who have enough games as each race) otherwise we cannot determine either 1 or 2.

When blizzard posts information about win/loss ratio of different matchups what does it mean? It doesn't mean anything. Its possible that player who play terran are simply more skilled on average than zerg, it's possible that zerg adds 50 points to a players skill, but the skill of the players playing it on average lowers it. Maybe cool is an example where he is the same skill as a terran, but that playing zerg gives him an advantage.

The answer is without equal parameters or conditions, all statistics are meaningless.


If you come up with a way for blizzard to get the information about balance without all of the neccesary inforamtion that i just described, please post it and then write a thesis and publish it please.

Also please use probability theory to explain your ideas or at least talk about the minimum information needed.

Developer for http://mtgfiddle.com
Tabbris
Profile Blog Joined June 2010
Bangladesh2839 Posts
Last Edited: 2010-10-08 22:40:47
October 08 2010 22:40 GMT
#2
I think this post is good enough to not be post in blogs . I agree. Blizzard has a very very hard job
ideadude
Profile Joined April 2010
United States7 Posts
Last Edited: 2010-10-08 23:07:42
October 08 2010 23:06 GMT
#3
Great analysis. Thanks.

Couldn't the game company recreate (in a sense) the initial experiment where people were (a) forced to play both sides against (b) random opponents? (When the initial 55% win ratio was discovered.)

If you make 1-in-50 games played match people randomly instead of using the match-making algorithm, you would get (b) above.

If you chose a random subset of these games across all races, wouldn't that be the same as (a)?

You would be able to say a random Black paired up against a random White wins x% of the time. This removes all skill from the equation since you didn't match them based on the calculated skill.

The one thing this experiment would miss is the assumption that equally skilled players are as likely to choose Black vs. White. (Maybe unskilled players are drawn towards White since the game released with the White campaign.)

How would you remove this affect? Maybe you grab randomly from people who have played at least 50 games? Maybe you limit things to people who have played White and Black a certain number of times? Not sure.
Patriot.dlk
Profile Blog Joined October 2004
Sweden5462 Posts
Last Edited: 2010-10-08 23:19:03
October 08 2010 23:17 GMT
#4
They need to focus on getting each race equally played, but how do you overcome a big influence of terrans and protoss due to those races being featured in the single player?

No idea. But I would really try to get them equally played and then collect a lot of different data. How many #1 guys of each race in their leagues, top 500, statistically what race wins most on [insert map], compare with big tournament results etc etc.

Going at this trying to get a smart algorithm in the works is just not how you perfom data mining, you need to look at it in EVERY possible perspective you can think of.

What you suggest here is basic probability and it's miles away from being useful
darmousseh
Profile Blog Joined May 2010
United States3437 Posts
October 08 2010 23:54 GMT
#5
I have had bad luck posting stuff in starcraft 2 general. Usually some moderator comes by and says "This is already being discussed here" or "This should be a blog post" so i usually post here.
Developer for http://mtgfiddle.com
Kaptein[konijn]
Profile Joined August 2005
Netherlands110 Posts
October 09 2010 08:44 GMT
#6
I agree, you can't make meaningful balance-related statements based on statistics in the current match making system. People make a lot of invalid implicit or explicit assumptions when they believe they can.
Please log in or register to reply.
Live Events Refresh
PiGosaur Monday
00:00
#40
CranKy Ducklings16
davetesta0
Liquipedia
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Nina 202
UpATreeSC 147
CosmosSc2 49
StarCraft: Brood War
MaD[AoV]8
Stormgate
NightEnD10
Dota 2
NeuroSwarm112
League of Legends
Grubby4167
Counter-Strike
Foxcn236
Coldzera 180
Super Smash Bros
hungrybox198
Mew2King99
AZ_Axe76
Other Games
summit1g12678
FrodaN2686
shahzam929
Day[9].tv737
Skadoodle260
ViBE206
C9.Mang0203
Maynarde137
Trikslyr66
Organizations
Other Games
gamesdonequick3547
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 18 non-featured ]
StarCraft 2
• Hupsaiya 78
• RyuSc2 29
• IndyKCrew
• sooper7s
• AfreecaTV YouTube
• Migwel
• intothetv
• LaughNgamezSOOP
• Kozan
StarCraft: Brood War
• HerbMon 38
• STPLYoutube
• ZZZeroYoutube
• BSLYoutube
Dota 2
• masondota21698
League of Legends
• Doublelift4077
• TFBlade945
Other Games
• Scarra995
• Day9tv737
Upcoming Events
uThermal 2v2 Circuit
15h 58m
Replay Cast
23h 58m
The PondCast
1d 9h
OSC
1d 12h
WardiTV European League
1d 15h
Replay Cast
1d 23h
Epic.LAN
2 days
CranKy Ducklings
3 days
Epic.LAN
3 days
CSO Contender
3 days
[ Show More ]
BSL20 Non-Korean Champi…
3 days
Bonyth vs Sziky
Dewalt vs Hawk
Hawk vs QiaoGege
Sziky vs Dewalt
Mihu vs Bonyth
Zhanhun vs QiaoGege
QiaoGege vs Fengzi
Sparkling Tuna Cup
4 days
Online Event
4 days
BSL20 Non-Korean Champi…
4 days
Bonyth vs Zhanhun
Dewalt vs Mihu
Hawk vs Sziky
Sziky vs QiaoGege
Mihu vs Hawk
Zhanhun vs Dewalt
Fengzi vs Bonyth
Esports World Cup
6 days
ByuN vs Astrea
Lambo vs HeRoMaRinE
Clem vs TBD
Solar vs Zoun
SHIN vs Reynor
Maru vs TriGGeR
herO vs Lancer
Cure vs ShoWTimE
Liquipedia Results

Completed

2025 ACS Season 2: Qualifier
RSL Revival: Season 1
Murky Cup #2

Ongoing

JPL Season 2
BSL 2v2 Season 3
Copa Latinoamericana 4
Jiahua Invitational
BSL20 Non-Korean Championship
Championship of Russia 2025
FISSURE Playground #1
BLAST.tv Austin Major 2025
ESL Impact League Season 7
IEM Dallas 2025
PGL Astana 2025
Asian Champions League '25
BLAST Rivals Spring 2025
MESA Nomadic Masters

Upcoming

CSL Xiamen Invitational
CSL Xiamen Invitational: ShowMatche
2025 ACS Season 2
CSLPRO Last Chance 2025
CSLPRO Chat StarLAN 3
BSL Season 21
K-Championship
RSL Revival: Season 2
SEL Season 2 Championship
uThermal 2v2 Main Event
FEL Cracov 2025
Esports World Cup 2025
Underdog Cup #2
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
IEM Cologne 2025
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.