|
Katowice25012 Posts
With no class to attend I've had a lot of free time recently. A typical way of dealing might be to catch up on sleep, spend time with family, or find a new hobby. Maybe use creative energy towards making a masterpiece. I've mostly been bored.
Deciding to use the time wisely, I opted to start 2011 off right and make some graphs, you know, play with some numbers. I've barely loaded up excel since SC2's release, and the last time I wrote too many words about a simple issue was in beta which is a damn shame.
This time its about positions in maps. At one point I considered piecing together a grand scheme involving length of game in relation to the maps and location, ideally to supply the map-hate brigade with ammunition but then Gom announced new maps and Odoakar timed games. Instead this will strip extraneous info and look at spawn locations.
The maps looked at were Lost Temple and Metalopolis, both 4 player maps with similar layouts and have been in GSL forever. We're looking at GSL only, from the start of the Open Season 1 until Jan 11, an arbitrary cutoff date set by when I last felt like updating the pictures.
![[image loading]](http://i.imgur.com/7rlr9.jpg) I had trouble visualizing my own description below so I made this professional looking diagram
The idea is easy: record where people spawned and see which won the most. To make it more fun I also categorized the distance between the two main base locations. Cross map (12-6 and 9-3 which split the map), close by air (12-3 and 9-6, the two mains are next to eachother but not through land) and close by walking (6-3 and 12-9, universally disliked by zerg). The numbers following are LT and Metalopolis combined. While the two have their own defining features that change game outcomes (Metal has wide open nats, cliffs on LT etc) they are a nice close enough here.
First look at this pretty graphic of which map quartile wins most often.
![[image loading]](http://i.imgur.com/mVmYY.png) Clock positions and their winrates for Metal and LT put together.
Probably nothing significant going on here, but the way it shakes up is pretty funny. 6 o'clock wins a solid 15% less than other locations. The split was pretty even between Metal and LT so it doesn't look like any specific feature, maybe it is mysteriously harder to play (conspiracy). Looking further is more interesting though.
The LT style architecture has a neat property in that a game will play out vastly different depending on starting location. This is true to some extent for all 4 player maps, but the effect is considerably more subtle on those with corner bases (Delta, Shakuras) where it might not be relevant until well into midgame.
To see how it effects each race this is split into each matchup and by distance. The P T columns show the PvT record, Protoss won 7 games to Terran's 6 when the players spawned cross map (12-6 or 9-3).
![[image loading]](http://i.imgur.com/JHMCv.png) Walk is 12-9 & 6-3, Air is 12-3 & 9-6, Cross is 12-6 & 9-3
When Idra spawned at 6 to MVP's 3 on Metalopolis to decide his Open Season 3 fate, Zelniq immediately typed "gg Idra nice try". He was right, MVP ran at him with SCVs and marines for a quick submission, an unsurprising result looking at past performance.
A few intersting things are going on here. It points towards confirming a lot of the greivances our community has, Terran wins a lot when the spawns are 12-9 or 6-3. PvT has trouble with shorter distances, but does okay cross map. Presumably this has to do with the past consensus that Protoss is weaker early game (maybe outdated after MC's win). ZvT changes drastically based on size between bases.
![[image loading]](http://i.imgur.com/n4O0o.png) I, too, dream in color and in rhyme.
Same data, but combines each race's matchups (mirrors need not apply). Shows the same basic ideas, in a way that is more convinient.
Notice how skewed the walk distance numbers are, Terran at nearly three quarters and Zerg a hair below a third. Then that winrate shrinks rapidly, nearly halving in cross map situations while Zerg's does the opposite. Overall, this supports the 'small map bad, big map good' thought process that has been particularly popular in the last week.
For me, its particularly satisfying to see opinion/intuition reflected in hard data this way. However, keep in mind that this spans the entire GSL lifetime, in addition to being a limited dataset. The PvT numbers specifically are least reliable, it seems like no one truly knew how to play that matchup until MC took a crown.
At Blizzcon they claimed to not keep position statistics internally, feeling it was slicing the data too thin to be useful. For strict balance concerns this is probably true. These charts suggest that maybe its not a totally useless metric, however, it lends to credability to the idea that the maps themselves need balancing or stronger playtesting.
At the very least its a fresh way to look at some commonly discussed issues. Go forth, TL denziens, be inspired to find new ways to look at common talking points.
Edit: Addendum
I made pie graphs that show what percentage each race's position was when winning. This is an aggregate total, I tallied up the wins then divided them up by what the spawn relationship was.
A nice way to show the data, most of Terran's wins come from close spawns which isn't surprising. The Protoss air portion is something I didn't see when doing the charts earlier though and is kind of fun!
|
I feel like these kind of GSL statistics are just kind of useless because the sample size is tiny. The game is new and the players are crap, this isn't enough to base any meaningful conclusions on.
|
Wow, great work sir!
Nice to see numbers give a basement to feelings, and gives some interesting perspective on what to come once GSL changes mappool maybe?
I guess tendencies get caught but nothing extremely worrying
+ Show Spoiler +Why can't every OP look like this? 
|
Canada5565 Posts
On January 13 2011 23:27 ChickenLips wrote:
I feel like these kind of GSL statistics are just kind of useless because the sample size is tiny. The game is new and the players are crap, this isn't enough to base any meaningful conclusions on.
75% win rate for Terran in close positions is pretty telling.
|
On January 13 2011 23:27 ChickenLips wrote:
I feel like these kind of GSL statistics are just kind of useless because the sample size is tiny. The game is new and the players are crap, this isn't enough to base any meaningful conclusions on.
You'd be surprised, but if you have data that is conclusive enough, you can conduct statistical analysis that will lead to an answer (ie. "Positions have no influence has a likelihood lower than 5%") with ~30 items.
Now, we haven't really reached that amount of data yet, but many games are playedat GSL, so this will sort out quite quickly.
|
Looks like most Terrans will be pretty screwed when GSL brings in some of the huge maps. I think everyone already had a hunch about that.
It's hard to say though, since there are a ton of Terrans in the GSL that, when compared to the very good ones such as Jinro, MVP, Ensnare, Clide, etc. are pretty bad and seem resigned to all-in every game, which short walk distance lends itself to. Not sure how the good Terrans will do on the super huge maps that are being looked at.
|
Yeah, I'm definitely starting to feel like they need to change the ladder map pool before they balance the game too specifically for shorter maps. I mean, Terran's win rate is low in far positions to compensate for it being so high in close positions, but if the maps all become large then Terran is gonna be way underpowered.
|
On January 13 2011 23:29 Xxio wrote:Show nested quote +On January 13 2011 23:27 ChickenLips wrote:
I feel like these kind of GSL statistics are just kind of useless because the sample size is tiny. The game is new and the players are crap, this isn't enough to base any meaningful conclusions on. 75% win rate for Terran in close positions is pretty telling.
They two rax a lot in the GSL. The close positions should help to pull that off. Might be why that percentage is so high.
|
And Blizzard said they werent concerned with the map pool at all...
|
Well statistics shows that in close air or cross positions the win/loss ration is pretty even but in close ground is really bad. That means that match ups would be much more fair if it would be impossible to spawn by close positions on LT and Meta, just like on shakuras. But well blizzard even took out shakuras lol.
|
Canada5565 Posts
On January 13 2011 23:36 Klelith wrote:Show nested quote +On January 13 2011 23:29 Xxio wrote:On January 13 2011 23:27 ChickenLips wrote:
I feel like these kind of GSL statistics are just kind of useless because the sample size is tiny. The game is new and the players are crap, this isn't enough to base any meaningful conclusions on. 75% win rate for Terran in close positions is pretty telling. They two rax a lot in the GSL. The close positions should help to pull that off. Might be why that percentage is so high.
Yea, exactly...
|
On January 13 2011 23:34 TestSubject893 wrote:
Yeah, I'm definitely starting to feel like they need to change the ladder map pool before they balance the game too specifically for shorter maps. I mean, Terran's win rate is low in far positions to compensate for it being so high in close positions, but if the maps all become large then Terran is gonna be way underpowered.
I disagree that Terran is underpowered in large maps. The reason Terran wins so much in close positions is because of how they're played right now. Right now, all the "good" players are doing super aggressive all in strategies and those do not work well in cross positions and large distances. The solution is not about balancing the races. It is learning to play differently and developing new strategies. Really good Terran players are fine on large maps and in cross positions because they know how to play with that play-style successfully.
TL;DR Large maps = different strategies.
|
Katowice25012 Posts
I imagine Metal would be a lot better if it spawned only cross map. It would be cool to add in game length stats to the position stuff, seems likely that the games with cross map would be a lot longer (and probably qualitatively better for spectating).
|
Interesting, im definitly not a fan of statistics interpretation, because I find that analysing the games themselves is far better. But well, it confirms some impressions we always had.
|
GSL's small sample size and vast range of skill (we see this disparity between code A and code S games) gives this data less merit, but I think the public's consensus is correct. Most people want larger maps because of zerg's mechanical advantage in those situations, and it leads to less all-in strategies. I'm sure Blizzard has the data for positions and maps, but chooses not to look at it for balancing (why should they, the forums will QQ enough for them to get the picture).
Hopefully bigger maps make it into the ladder pool soon, or we will see a lot more complaining and evidence being dug up about positional imbalance on maps. Blizzard can only turn a blind eye to this for so long.
Edit: Additionally, it may be that many of the past balances (Bunker time, Tank Damage, no Flux Veins, Roach range, etc.) were not really necessary in longer, cross-position situations. Positions actually affect the effectiveness of the individual units drastically, as most players understand. A 7 Roach Rush is drastically less effective the longer it takes to get the 7 Roaches to the opponent's base, so in a sense, the roach is less effective the longer the spawning positions when using that strategy. A buff like +1 roach range makes that strategy even MORE effective with close positions, because of the timing and the resources necessary to defend it. Of course, the roach buff is still in effect all game long, but I think slight variations in unit stats will make positions in some MUs much more volatile. When you spawn close to your opponent, it's a completely different game with a completely different set of viable strategies.
|
Props for the statistics. This only says we really need more tech&expo friendly maps to understand the balance better.
All the 2player maps in the pool are so small... I find myself in starvation mode a lot more often than in BW.
|
i loooove statistics like that, thanks for all the effort you put into that. good job!
|
Katowice25012 Posts
I added a new graph at the bottom. Its pie! yay!
When reading anything about numbers, keep in mind that the numbers themselves never prove anything one way or another and they're not meant to. It is one more piece of information to use when looking at an issue, weigh it appropriately as you would when judging something a commentator says during the game. People are good at finding the bias in the data, but bad at using the data itself to help form an opinion based on a variety of other sources at the same time (players opinion, personal experience). They're never entirely useless in the same way they can never be used to base a definitive conclusion on.
When you spawn close to your opponent, it's a completely different game with a completely different set of viable strategies.
It is, which makes it really cool that matchup numbers show some difference when looking at spawns. I've had a good laugh at a few GSL games since making those graphs though, its fun to watch live with knowledge of what past performance looked like.
|
On January 13 2011 23:27 ChickenLips wrote:
I feel like these kind of GSL statistics are just kind of useless because the sample size is tiny. The game is new and the players are crap, this isn't enough to base any meaningful conclusions on.
It's very telling
|
Why not do the same on Master's league ladder stats. The sample size here is too small for me to care, zvt anecdotes aside.
|
|
|
|
|
|
EPT![[image loading]](http://i.imgur.com/2GG5S.png)
![[image loading]](http://i.imgur.com/Z6VI4.png)
