• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 05:27
CEST 11:27
KST 18:27
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Power Rank - Esports World Cup 202533RSL Season 1 - Final Week9[ASL19] Finals Recap: Standing Tall15HomeStory Cup 27 - Info & Preview18Classic wins Code S Season 2 (2025)16
Community News
BSL Team Wars - Bonyth, Dewalt, Hawk & Sziky teams4Weekly Cups (July 14-20): Final Check-up0Esports World Cup 2025 - Brackets Revealed19Weekly Cups (July 7-13): Classic continues to roll8Team TLMC #5 - Submission re-extension4
StarCraft 2
General
RSL Season 1 - Final Week Power Rank - Esports World Cup 2025 RSL Revival patreon money discussion thread The GOAT ranking of GOAT rankings Esports World Cup 2025 - Final Player Roster
Tourneys
Esports World Cup 2025 Sparkling Tuna Cup - Weekly Open Tournament Sea Duckling Open (Global, Bronze-Diamond) FEL Cracov 2025 (July 27) - $8000 live event RSL: Revival, a new crowdfunded tournament series
Strategy
How did i lose this ZvP, whats the proper response
Custom Maps
External Content
Mutation # 483 Kill Bot Wars Mutation # 482 Wheel of Misfortune Mutation # 481 Fear and Lava Mutation # 480 Moths to the Flame
Brood War
General
BSL Team Wars - Bonyth, Dewalt, Hawk & Sziky teams BW General Discussion ASL20 Preliminary Maps BGH Auto Balance -> http://bghmmr.eu/ Flash Announces (and Retracts) Hiatus From ASL
Tourneys
[CSLPRO] It's CSLAN Season! - Last Chance [Megathread] Daily Proleagues [BSL 2v2] ProLeague Season 3 - Friday 21:00 CET The Casual Games of the Week Thread
Strategy
Simple Questions, Simple Answers I am doing this better than progamers do.
Other Games
General Games
Stormgate/Frost Giant Megathread Nintendo Switch Thread [MMORPG] Tree of Savior (Successor of Ragnarok) Path of Exile CCLP - Command & Conquer League Project
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Vanilla Mini Mafia
Community
General
US Politics Mega-thread Things Aren’t Peaceful in Palestine Russo-Ukrainian War Thread The Games Industry And ATVI Stop Killing Games - European Citizens Initiative
Fan Clubs
SKT1 Classic Fan Club! Maru Fan Club
Media & Entertainment
[\m/] Heavy Metal Thread Anime Discussion Thread Movie Discussion! [Manga] One Piece Korean Music Discussion
Sports
2024 - 2025 Football Thread Formula 1 Discussion TeamLiquid Health and Fitness Initiative For 2023 NBA General Discussion
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List
Blogs
Ping To Win? Pings And Their…
TrAiDoS
momentary artworks from des…
tankgirl
from making sc maps to makin…
Husyelt
StarCraft improvement
iopq
Socialism Anyone?
GreenHorizons
Customize Sidebar...

Website Feedback

Closed Threads



Active: 677 users

ZvP is imbalanced - Page 33

Forum Index > BW General
Post a Reply
Prev 1 31 32 33 34 35 47 Next All
Elite00fm
Profile Joined January 2008
United States548 Posts
October 20 2009 05:46 GMT
#641
also, there is a very high chance you miscalculated the standard deviation
motbob
Profile Blog Joined July 2008
United States12546 Posts
October 20 2009 05:47 GMT
#642
On October 20 2009 14:46 Elite00fm wrote:
also, there is a very high chance you miscalculated the standard deviation

OK

tell me what it actually is and how you got it, please.
ModeratorGood content always wins.
Elite00fm
Profile Joined January 2008
United States548 Posts
October 20 2009 05:48 GMT
#643
On October 20 2009 14:46 motbob wrote:
Show nested quote +
On October 20 2009 14:44 Elite00fm wrote:
set null hypothesis to the winrate zerg had for the past 5 years or so before march 1st of this year

Getting that data would be pure hell. No thanks.


Yeah good point, I guess we could estimate it at like 53-55% though
zulu_nation8
Profile Blog Joined May 2005
China26351 Posts
October 20 2009 05:48 GMT
#644
On October 20 2009 14:44 Elite00fm wrote:
set null hypothesis to the winrate zerg had for the past 5 years or so before march 1st of this year


should it be that or the average of the zvp stats over every 7 month period ever in progaming? Since it should be the same sample sizes?
zulu_nation8
Profile Blog Joined May 2005
China26351 Posts
October 20 2009 05:54 GMT
#645
or the same amount of games, not time.
motbob
Profile Blog Joined July 2008
United States12546 Posts
Last Edited: 2009-10-20 05:55:33
October 20 2009 05:55 GMT
#646
On October 20 2009 14:48 zulu_nation8 wrote:
Show nested quote +
On October 20 2009 14:44 Elite00fm wrote:
set null hypothesis to the winrate zerg had for the past 5 years or so before march 1st of this year


should it be that or the average of the zvp stats over every 7 month period ever in progaming? Since it should be the same sample sizes?

No. Elite's suggestion is OK because it compares the recent win rate to the historical ZvP winrate, which might actually serve the purposes of this thread better. My method compares the recent winrate to a rate of 50%. But your suggestion doesn't make that much sense... a rate is a rate.
ModeratorGood content always wins.
Heyoka
Profile Blog Joined March 2008
Katowice25012 Posts
October 20 2009 05:59 GMT
#647
Is a rate still a rate when you estimate the average at 50% but then go on to say your expected variance is from 1% to 99%?
@RealHeyoka | ESL / DreamHack StarCraft Lead
motbob
Profile Blog Joined July 2008
United States12546 Posts
October 20 2009 06:02 GMT
#648
On October 20 2009 14:59 heyoka wrote:
Is a rate still a rate when you estimate the average at 50% but then go on to say your expected variance is from 1% to 99%?

Uh, yeah, that's the nature of binary data.
ModeratorGood content always wins.
zulu_nation8
Profile Blog Joined May 2005
China26351 Posts
Last Edited: 2009-10-20 06:26:24
October 20 2009 06:22 GMT
#649
Standard deviation means how far the mean % from other samples of 800 games in the history of progaming can deviate from the null hypothesis. Which should be something like .05 or .1. What your test proved was that basically your numbers are wrong.
Elite00fm
Profile Joined January 2008
United States548 Posts
Last Edited: 2009-10-20 06:29:59
October 20 2009 06:27 GMT
#650
Wouldn't you solve this by finding the standard deviation of win % between these games, then find the z score using this value?

edit: i'm a little rusty when it comes to stats rofl
motbob
Profile Blog Joined July 2008
United States12546 Posts
October 20 2009 06:33 GMT
#651
On October 20 2009 15:22 zulu_nation8 wrote:
Standard deviation means how far the mean % from other samples of 800 games in the history of progaming can deviate from the null hypothesis. Which should be something like .05 or .1. What your test proved was that basically your numbers are wrong.

Go into excel and use the command stdev on a bunch of numbers. That's the standard deviation I'm talking about. You plug that into this equation (for omega):

[image loading]


Please don't criticize my methods again until you do a statistical test of your own. After all, you said you would.
ModeratorGood content always wins.
Matrijs
Profile Joined May 2009
United States147 Posts
October 20 2009 06:44 GMT
#652
If the purpose is to prove that Zergs have had the advantage over Protoss players the last 3 months or whatever time period, why isn't a null hypothesis of winrate = 50% ideal for that purpose?

If we use the historical average, we invite the argument that Zergs have had a historical advantage over Protoss players, which would corrupt our test. The goal for mapmakers should be 50% winrates over time for each race in all three matchups - why shouldn't we measure their results against that goal?
Elite00fm
Profile Joined January 2008
United States548 Posts
October 20 2009 06:51 GMT
#653
On October 20 2009 15:44 Matrijs wrote:
If the purpose is to prove that Zergs have had the advantage over Protoss players the last 3 months or whatever time period, why isn't a null hypothesis of winrate = 50% ideal for that purpose?

If we use the historical average, we invite the argument that Zergs have had a historical advantage over Protoss players, which would corrupt our test. The goal for mapmakers should be 50% winrates over time for each race in all three matchups - why shouldn't we measure their results against that goal?


Because the game has always been slightly T>Z>P>T, and this sort of equilibrium has been deemed balanced. It is already assumed that zergs have had a historical advantage over protoss, what we are trying to determine is if in the past 7 months is if this increased winrate of the zergs is so much more than the historical figure that the probability of this occurring to do variance is very small, and if infact an imbalance has emerged in the matchup.
Matrijs
Profile Joined May 2009
United States147 Posts
Last Edited: 2009-10-20 07:19:00
October 20 2009 07:08 GMT
#654
On October 20 2009 15:51 Elite00fm wrote:
Show nested quote +
On October 20 2009 15:44 Matrijs wrote:
If the purpose is to prove that Zergs have had the advantage over Protoss players the last 3 months or whatever time period, why isn't a null hypothesis of winrate = 50% ideal for that purpose?

If we use the historical average, we invite the argument that Zergs have had a historical advantage over Protoss players, which would corrupt our test. The goal for mapmakers should be 50% winrates over time for each race in all three matchups - why shouldn't we measure their results against that goal?


Because the game has always been slightly T>Z>P>T, and this sort of equilibrium has been deemed balanced. It is already assumed that zergs have had a historical advantage over protoss, what we are trying to determine is if in the past 7 months is if this increased winrate of the zergs is so much more than the historical figure that the probability of this occurring to do variance is very small, and if infact an imbalance has emerged in the matchup.


I don't see this as a particularly compelling argument. If maps are sufficient to significantly alter, and even reverse, the T>Z>P>T historical pattern of imbalance, why should we accept that imbalance? Why shouldn't we aim for T=Z=P=T?

Ignoring that, it seems to me that the proper test is a one-tailed one-proportion z-test:
http://www.acastat.com/Statbook/ztest1.htm

The null hypothesis would be that the Zerg winrate over the sampled period equals the historical rate, which we will approximate conservatively as 55%.

The alternative hypothesis would be that the Zerg winrate over the sampled period exceeds the historical rate.

By my calculation, that test gives us a z-value around 2.5, which is easily high enough to conclude that the current Zerg winrate exceeds the historical rate, even given the conservative assumption of a 55% historical winrate.

Edit: Including my calculations so others can check my work:
Standard error = sqrt((.55)(.45)/855) ~ .01701
Z-value = (.5921-.55)/.01701 ~ 2.475
Elite00fm
Profile Joined January 2008
United States548 Posts
Last Edited: 2009-10-20 07:22:56
October 20 2009 07:21 GMT
#655
How did you get that standard error? The formula is stdev/sqrt(n) isn't it?
Matrijs
Profile Joined May 2009
United States147 Posts
Last Edited: 2009-10-20 07:45:25
October 20 2009 07:24 GMT
#656
On October 20 2009 16:21 Elite00fm wrote:
How did you get that standard error?


The formula's in the link I posted.

SE = square root (p(q)/n)

where p = population proportion (here, the estimated historical Zerg winrate, .55),
q = (p-1)
and n = sample size (855 games sampled)

So, it seems to me that, yes, something has changed recently. I see several possibilities:
1) Metagame shift. Protoss players may be struggling to find a good counter for the current popular 3 hatch spire to 5 hatch hydra build. This could be either a temporary effect, which will disappear or reverse itself once Protoss players discover an effective counter, or it could be a permanent effect, if the matchup is sufficiently "played out" strategically.
2) Maps. The new maps may be more Zerg-favored in this matchup than previous maps.
3) Mechanics. No one denies that the mechanics of modern pro players are vastly superior to those in the past. It may be that improved mechanics have more of a positive impact on a Zerg's effectiveness than they do on that of a Protoss.

The bottom line, it seems to me, is that unless we see a reversal of the trend over the next few months, tournament and league organizers should start looking at ways to tweak the existing map pool to bring the matchup back into balance, regardless of the cause. A 60% win rate for one race over another is just bad for the game at the competitive level.
zulu_nation8
Profile Blog Joined May 2005
China26351 Posts
Last Edited: 2009-10-20 16:15:58
October 20 2009 16:14 GMT
#657
On October 20 2009 15:33 motbob wrote:
Show nested quote +
On October 20 2009 15:22 zulu_nation8 wrote:
Standard deviation means how far the mean % from other samples of 800 games in the history of progaming can deviate from the null hypothesis. Which should be something like .05 or .1. What your test proved was that basically your numbers are wrong.

Go into excel and use the command stdev on a bunch of numbers. That's the standard deviation I'm talking about. You plug that into this equation (for omega):

[image loading]


Please don't criticize my methods again until you do a statistical test of your own. After all, you said you would.


motbob i think its pretty obvious a standard deviation of 50% is wrong, the sooner you realize this and drop the im an econ major i know stats attitude, the faster we can move on.

A win is not 100%, and a loss is not 0%, that would be the standard deviation if brood war had like 80% half wins or something, even then that would not make sense since there would be no statistical significance since EVERYTHING would fall under the range of 0 and 1, thats why your numbers are so messed up.
Black Gun
Profile Blog Joined July 2009
Germany4482 Posts
Last Edited: 2009-10-20 16:35:56
October 20 2009 16:29 GMT
#658
On October 20 2009 13:26 motbob wrote:
OK I just found a much easier way to compile map matchup data! So when I get access to Stata, I'll have better data. I'll do this for all stats since March 1st, 2009.

Byzantium 3: 25-13
Byzantium 2: 30-11
Tears of the Moon: 1-0
New Autumn Wind: 3-1
Medusa: 34-23
Tau Cross: 7-7
Carthage 2: 2-4
Carthage: 0-1
Battle Royale: 4-5
Holy World: 4-3
Shades of Twilight: 1-3
Colosseum II: 2-4
Andromeda: 7-19 (?????)
Neo Harmony: 5-0
God's Garden: 56-44
Carthage 3: 1-0
Outsider: 41-27
Neo Medusa: 34-25
Return of the King: 47-22
Eye of the Storm: 1-1
El Niño: 1-1
Destination: 110-72 (this changed significantly since the time of the OP... EVER OSL prelims used it)
Tornado: 5-1
Outsider SE: 2-0
Moon Glaive: 2-3
Match Point: 3-4
Heartbreak Ridge: 90-64
Fighting Spirit: 6-3

Overall: 524-361, or 59.21%



the variable we are discussing here is binary, hence the estimator of the mean is the proportion p = 524/(524+361) = 0.592. the sample size is large enough to use a normal approximation.

if we assume a null-hypothesis of a balanced winrate of p0 = 50%, then in the corresponding test we need to use this p0 and not p in the formula for the standard deviation!

the test statistic then is:

Z = sqrt(n)*(p - p0)/sqrt[p0*(1-p0)] = sqrt(885)*(0.5921 - 0.5)/sqrt(0.5*(1-0.5)) = 5.479 -> highly significant.


if we assume a null-hypothesis of p0 = 0.55, then we obtain a Z of 2.517 -> p-value of 0.0059, ie significant even on a confidence level of 99%.

so the ZvP-winrate during that timeframe significantly exceeds 55%.
"What am I supposed to do against this?" - "Lose!" :-]
zulu_nation8
Profile Blog Joined May 2005
China26351 Posts
October 20 2009 16:43 GMT
#659
can you explain to me why 1-P0 is the SD
Muirhead
Profile Blog Joined October 2007
United States556 Posts
Last Edited: 2009-10-20 16:45:00
October 20 2009 16:44 GMT
#660
If you guys still have trouble doubting the significance, ask yourself why we even need statistics in such a simple case. These numbers are small enough and the question simple enough that we don't need any fancy approximations or limits of the binomial distribution.

ZvP stats are 524-361

If you flip a coin 885 times, the chance of heads coming up 361 times or less is

(Sum(i=0 to 361) (885 C i))/(2^885)

If the coin has, say, a historical 47% chance of heads, then the chance of heads coming up 361 times or less is

Sum(i=0 to 361) (885 C i) * (.47)^i*(.53)^(885-i)

Someone can figure these out in 10 seconds with their TI-89 or Mathematica... unfortunately I can't right now. No need to hide behind fancy stats here!
starleague.mit.edu
Prev 1 31 32 33 34 35 47 Next All
Please log in or register to reply.
Live Events Refresh
Next event in 33m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Harstem 244
ProTech70
StarCraft: Brood War
Nal_rA 11965
Hyuk 2652
ggaemo 832
Jaedong 351
ToSsGirL 260
EffOrt 172
Mini 155
Pusan 141
Soma 50
Sacsri 47
[ Show more ]
Backho 32
Hyun 31
NaDa 28
Sharp 25
Rush 21
ajuk12(nOOB) 21
soO 20
Bale 11
ivOry 4
Britney 0
Dota 2
XcaliburYe210
BananaSlamJamma155
Fuzer 78
Counter-Strike
fl0m464
sgares114
oskar103
Other Games
summit1g2962
singsing766
ceh9605
SortOf83
Organizations
Other Games
gamesdonequick1071
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 14 non-featured ]
StarCraft 2
• Berry_CruncH453
• 3DClanTV 33
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• LaughNgamezSOOP
• Migwel
• sooper7s
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• WagamamaTV308
• lizZardDota275
Upcoming Events
Esports World Cup
33m
ByuN vs Zoun
SHIN vs TriGGeR
Cyan vs ShoWTimE
Rogue vs HeRoMaRinE
Clem vs Solar
Reynor vs Maru
herO vs Cure
Serral vs Classic
CranKy Ducklings19
Esports World Cup
1d
Esports World Cup
2 days
CranKy Ducklings
3 days
BSL20 Non-Korean Champi…
3 days
CSO Cup
3 days
BSL20 Non-Korean Champi…
3 days
Bonyth vs Sziky
Dewalt vs Hawk
Hawk vs QiaoGege
Sziky vs Dewalt
Mihu vs Bonyth
Zhanhun vs QiaoGege
QiaoGege vs Fengzi
FEL
3 days
BSL20 Non-Korean Champi…
4 days
BSL20 Non-Korean Champi…
4 days
Bonyth vs Zhanhun
Dewalt vs Mihu
Hawk vs Sziky
Sziky vs QiaoGege
Mihu vs Hawk
Zhanhun vs Dewalt
Fengzi vs Bonyth
[ Show More ]
Sparkling Tuna Cup
6 days
Online Event
6 days
Liquipedia Results

Completed

CSL Xiamen Invitational
Championship of Russia 2025
Murky Cup #2

Ongoing

Copa Latinoamericana 4
Jiahua Invitational
BSL20 Non-Korean Championship
Esports World Cup 2025
CC Div. A S7
Underdog Cup #2
IEM Cologne 2025
FISSURE Playground #1
BLAST.tv Austin Major 2025
ESL Impact League Season 7
IEM Dallas 2025
PGL Astana 2025
Asian Champions League '25

Upcoming

CSLPRO Last Chance 2025
CSLPRO Chat StarLAN 3
BSL Season 21
RSL Revival: Season 2
SEL Season 2 Championship
uThermal 2v2 Main Event
FEL Cracov 2025
HCC Europe
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.