• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EST 07:21
CET 13:21
KST 21:21
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Intel X Team Liquid Seoul event: Showmatches and Meet the Pros10[ASL20] Finals Preview: Arrival13TL.net Map Contest #21: Voting12[ASL20] Ro4 Preview: Descent11Team TLMC #5: Winners Announced!3
Community News
$5,000+ WardiTV 2025 Championship2[BSL21] RO32 Group Stage1Weekly Cups (Oct 26-Nov 2): Liquid, Clem, Solar win; LAN in Philly2Weekly Cups (Oct 20-26): MaxPax, Clem, Creator win62025 RSL Offline Finals Dates + Ticket Sales!10
StarCraft 2
General
RotterdaM "Serral is the GOAT, and it's not close" TL.net Map Contest #21: Voting RSL S3 Round of 16 [TLCH] Mission 7: Last Stand Weekly Cups (Oct 26-Nov 2): Liquid, Clem, Solar win; LAN in Philly
Tourneys
Sea Duckling Open (Global, Bronze-Diamond) $5,000+ WardiTV 2025 Championship $3,500 WardiTV Korean Royale S4 WardiTV Mondays Sparkling Tuna Cup - Weekly Open Tournament
Strategy
Custom Maps
Map Editor closed ?
External Content
Mutation # 498 Wheel of Misfortune|Cradle of Death Mutation # 497 Battle Haredened Mutation # 496 Endless Infection Mutation # 495 Rest In Peace
Brood War
General
SnOw's ASL S20 Finals Review [ASL20] Ask the mapmakers — Drop your questions [BSL21] RO32 Group Stage BGH Auto Balance -> http://bghmmr.eu/ RSL S3 ro16
Tourneys
BSL21 Open Qualifiers Week & CONFIRM PARTICIPATION [ASL20] Grand Finals Small VOD Thread 2.0 The Casual Games of the Week Thread
Strategy
Current Meta How to stay on top of macro? PvZ map balance Soma's 9 hatch build from ASL Game 2
Other Games
General Games
Dawn of War IV Nintendo Switch Thread Stormgate/Frost Giant Megathread ZeroSpace Megathread General RTS Discussion Thread
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Deck construction bug Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread SPIRED by.ASL Mafia {211640}
Community
General
US Politics Mega-thread Russo-Ukrainian War Thread Things Aren’t Peaceful in Palestine Dating: How's your luck? Canadian Politics Mega-thread
Fan Clubs
White-Ra Fan Club The herO Fan Club!
Media & Entertainment
Anime Discussion Thread [Manga] One Piece Movie Discussion! Korean Music Discussion Series you have seen recently...
Sports
2024 - 2026 Football Thread MLB/Baseball 2023 TeamLiquid Health and Fitness Initiative For 2023 Formula 1 Discussion
World Cup 2022
Tech Support
SC2 Client Relocalization [Change SC2 Language] Linksys AE2500 USB WIFI keeps disconnecting Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List Recent Gifted Posts
Blogs
Why we need SC3
Hildegard
Career Paths and Skills for …
TrAiDoS
Reality "theory" prov…
perfectspheres
Our Last Hope in th…
KrillinFromwales
Customize Sidebar...

Website Feedback

Closed Threads



Active: 1728 users

Quantitative Analysis Tool

Forum Index > SC2 General
Post a Reply
1 2 3 Next All
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
Last Edited: 2014-03-11 21:21:52
March 11 2014 21:15 GMT
#1
Hello everyone!

It's WALL OF TEXT AND PICTURES TIME

Forward TL;DR
What I've created thus far is just a hodge-podge of random stuff I've found I can garner from replays these days, as well as what what I think people could find useful with them.
This is meant to answer a set of questions about large numbers of games of StarCraft.

Before I go any further: Shoutouts to TLO for letting me use all his ladder games. What you're seeing is information from his last 380 ladder games.

Introduction (you could skip this bit I suppose!):
I've made a few posts in the past saying "HEY LOOK AT WHAT I'VE DONE!" only to have something come along and stop it working (see http://www.teamliquid.net/forum/starcraft-2/309211-starcraft-map-analysis-stargraphed).
So, naturally, I decided to do it again.

This time, with the 2.0.8 patch last year, I found out that a lot more information was stored in replays. In the past it was just raw user inputs that was simulated in the game when you ran the replay.
However, now this is not the case. You have seen with things like SCELight that you can get the buildings you created, upgrades made, etc. With tools like that giving you qualitative analysis of each of your games, and sites such as Aligulac giving you quantitative analysis of players and how they do in tournaments, I thought maybe I could combine the two. Turns out, I can!

I started out thinking that, if tournaments release their replays, I can grab all the games from all the players and use this to profile them. Create an overview of this player in a tournament setting. Could I use this to predict what they would do on any given map in a given matchup? Could I say "Ziggy says there's a 74% chance that MC will go quick stargate on this map vs Zerg"? Well, maybe, but as I was working on it and talking to some people about it, it turned out that we could turn this into a training tool, or in fact a tool that could actually do quite a few things.
Introduction over

Parsing Replays:
This tool uses Blizzard's S2 Protocol (https://github.com/Blizzard/s2protocol - Thanks, Blizzard!). I have not written my own replay parsing engine as of yet. I might do it I get the time and/or inclination to do so. As for now, this tool provides what I'm after doing!

It takes ~ 15-60 seconds to parse a replay based on time. Because of this, Replays are then stored off in a format that just keeps track of what I'm interested in. This means I can load replays much faster after they've been parsed. I do this because, unlike qualitative tools, I'm not interested in how you hotkey your army. I'm just here to give you STATS ABOUT ALL YOUR GAMES AT ONCE. RIGHT TO YOUR FACE.

Player Matchup Overviews:
You want to know how well you've been doing in each of your matchups? NO PROBLEM!
[image loading]
Obviously I have no real information from the last 2-7 days, because he's been at SSC
So far so Aligulac, but there's more!

Build Orders:
"What does a build look like?"

I have included the ability to configure build orders.
[image loading]
With this you can fill in any length of build, beginning and ending at any point. This is a build where Zerg goes onto 3 bases, at least one queen per base, gets a reasonably fast ling speed (7 minutes) and at least 24 drones.

When configuring the build, each section has its own start/end point. If you wanted to, you could add another 8 lings that start and end at a different point, it's all good.

Or you could use it to filter replays based on whether a roach warren was built at all:
[image loading]

Player Build Overviews:
"What do my games look like?"
A straight up look at how your games have been
[image loading]

Can be toggled to show upgrades/units, too!
[image loading]

I tried to add some extra information and functionality to this, so -
Want to see the times instead of food values for these, and group them up to the first 7:30? YOU SURE CAN!
[image loading]

It will also give you information in each grouped build item. You can see first/average/latest time they were placed:
[image loading]

As you can see, it gives you your overall win percentage, as well as the lengths of all the games you've played. On the right, you can see it copies that information. This is actually updated based on which of the replays you've selected, as such:
[image loading]

From this we can see that TLO's 3 post common builds up to the 7:30 mark actually give him a slightly higher win rate than anything else.
It is also possible to filter by map as well.

You can see a bunch of strings on the right under the filtered win percentages. Those are all the replays that correspond to the highlighted rows. If you have access to them and they are in the location from which they are parsed, you can copy them off to another folder for a closer look, if you so like.

Why would you do this? It's possible to filter, as you can see in the top right, based on your saved build order configurations. Useful if you want to practice a build and copy out your games where you've done them. You can tag replays, too, which will allow you to easily filter those replays in future.

Build Order Scoring:
"How good am I getting at this build?"
This one is very much a work in progress. Is it possible to rate how well you do a build? Still in the process of finding out, but this is what I have so far:
[image loading]

So, you can pick a player and a build and it'll show information on that build. You can see the best, average and worst times for any replay that fulfils the build order criteria. This extends to each element of the build.

The graphs show:
1) The completion times and how often that time is hit, as well as how many of those games you win with.
2) The time at which you completed the build over... time. If you see what I mean.

On the right you can see the "best" values for each build. The bottom right allows you to compare an unparsed replay. If it contains the build you're filtering against it'll show you where it comes in relation to the already parsed replays. COMPARE YOURSELF TO THE PROS, YO.

Build Order Wars:
"What should I be doing against X?"
Something that is generally already known, but comparison of build orders.
Some basic ones: 3 base zerg (3 hatches before 8 minutes) vs 3 base Protoss (3 nexuses before 10 minutes):
[image loading]

Zerg wins 53 out of 85 of these games. you can see how the matchup swings back and forth over time. I have no idea why. This, I think, is just straight up for numbers. We never see enough numbers in StarCraft casts.
One thing you saw in the first link I showed was a heatmap. I bet you're all wondering where those are. FEAR NOT!

Heat Maps:
That's right. I have heat maps for two different kinds of things.
Buildings:
[image loading]

You can filter by map, matchup, spawn location, building type, replay filter.
You want to know where protoss builds proxy pylons before the 9 minute mark on Daedelus, when they spawn top left? I GOT YOU, BRO.
[image loading]

Obviously this is going to be a really small subset of games, hence there aren't many (it's all Protoss vs TLO games on this map!)
As well as being useful to know where people are building proxy pylons at you, you can see the glory that is where all the units have died.
[image loading]

This can, again, be filtered in the same way (except not by building, that would be odd).
Aspiring map makers may be able to use this to make sure that fights are varied and spread over the map, that all bases are taken where possible and that it's not just all focused on one area the whole time.
I'm basically just asking you not make Habitation Station
[image loading]
The "All Mid" of SC2 Maps

Anyway, that's all I've got so far:
Pre-Emptive Answers
It's rather ugly
Yes, I know it's not very pretty. I'm bad at art based stuff, and I basically learned WPF as I was making this, so it's a bit sloppy in places. However, it works!

Can I use this?
I'll be potentially releasing this for use in the next couple of weeks. I'll bundle everything that you would need to use to run it where I can. However, you will most likely need to install Python (2.7) yourself to make it work. This is to run S2Protocol. This requirement will possibly be removed in later iterations if I can get the time to write my own replay parsing engine.

That's a dumb name
I can't think fo a better one. I've already used StarGraphed. Maybe "StarGraphed: The Next Generation" and I could rename all the buttons that do things to "Make It So"

Feel free to hit me up here on a PM or grab me on Twitter @Gowerly if you have any questions or suggestions. I'll add the most common ones to the OP here.

Thanks for reading!
I will reduce you to a series of numbers.
Liquid`Snute
Profile Blog Joined July 2010
Norway839 Posts
March 11 2014 21:21 GMT
#2
sick
Team Liquid
MrMedic
Profile Joined November 2010
Canada452 Posts
March 11 2014 21:27 GMT
#3
This is pretty sweet! nice work, I'd love to use this.
RHWY
Profile Blog Joined December 2011
Ireland43 Posts
March 11 2014 21:33 GMT
#4
Hi Dave, Robert here, I was wondering what you are going to do next? Do I have to use my own replays or can I use replays from pro players and tournaments too?

@es_performance @LiquidTLO @LiquidRet
MilLorD
Profile Joined September 2011
Germany36 Posts
March 11 2014 21:33 GMT
#5
Amazing work!
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 11 2014 21:40 GMT
#6
On March 12 2014 06:33 Yapa wrote:
Hi Dave, Robert here, I was wondering what you are going to do next? Do I have to use my own replays or can I use replays from pro players and tournaments too?


You can set it up to automatically parse any replays that are added to a folder, so it's always up to date with your laddering progress.

You can also get it to just parse a bunch of replays in a folder, too. They don't have to be yours (as you can see by me using TLO's) they just have to be replays.

I'm hoping to grab replays from SSC (if they're released) and/or IEM and doing some analysis on them.
I'm looking to get things like

Most common proxy locations (rax, pylons, etc)
From this I'm hoping to be able to figure out the best scouting routes to check for these things

Most used builds/Most successful builds
Which builds were used the most and which were the most successful? Which matchup outcomes changed the most over the duration of a game?

Anything that warrants discussion
Do we see that Zergs end up being defensive?
Maybe that Protoss vs Terran ends up with a slow push from the Terran base to Protoss'?

I think there's a lot that can be discussed by looking at a lot of replays. I'm hoping to get the chance to do that!

Go Take, release replays! :D:D
I will reduce you to a series of numbers.
BronzElite
Profile Joined November 2011
Germany29 Posts
March 12 2014 08:58 GMT
#7
Oh my God! All of TLO's secrets out in the Open!!!!111eleven

Seriously, great work! Nice to hear that even Blizz themselves are now giving some official attention to data mining SC2 replays. But just as with StarGraphed, all credit goes to you for turning raw data into insight. Beautiful!
AchillesStarcraft
Profile Joined March 2014
United States1 Post
March 12 2014 15:52 GMT
#8
This is awesome!! Very informative read
great work man.
https://www.youtube.com/user/AchillesStarcraft
Pirfiktshon
Profile Joined June 2013
United States1072 Posts
Last Edited: 2014-03-12 16:09:04
March 12 2014 16:07 GMT
#9
I am .... speechless.... this is so beautiful I need a minute ...............................................................

Ok, just 1 question why can't I have this now? and will I have to purchase?
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 12 2014 16:11 GMT
#10
I need to finish up some steps:
- I don't have pictures for all the maps and it's tedious using the map editor to get them all
- I need to make sure I can't make it crash by doing things like mashing buttons or something. I'd like to make sure that when it's released I don't get 50% of the people using it saying "My PC exploded and now there's metal in my face" or something.

Also, it'll be free. I'm not looking to make any money from this. I just thought it was something cool to do.
I will reduce you to a series of numbers.
Grovbolle
Profile Blog Joined July 2011
Denmark3811 Posts
Last Edited: 2014-03-12 16:49:43
March 12 2014 16:22 GMT
#11
I just came.

Also, I approve of the phrase: "So far so Aligulac"
Lies, damned lies and statistics: http://aligulac.com
Pirfiktshon
Profile Joined June 2013
United States1072 Posts
March 12 2014 16:24 GMT
#12
Well Gowerly if there is anything I can do to help like try do the beta for you or anything else you need just let me know
Sikian
Profile Blog Joined September 2011
Spain177 Posts
March 12 2014 16:34 GMT
#13
This tickles my statistical representation hormones.
Helping Starbow :: a.k.a. SoaH
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 12 2014 23:31 GMT
#14
Thanks to iHiro for this one:
I should be able to have this work for Starbow maps as well. It should take a little bit of modification to work with the new unit types.
There was an invitational that was done recently with it, so I will try to do some small analysis on those games.
I'll post more when it's done.
I will reduce you to a series of numbers.
vult
Profile Blog Joined February 2012
United States9400 Posts
March 12 2014 23:44 GMT
#15
This is so sick, thank you for this!
I used to play random, but for you I play very specifically.
Valeranth
Profile Joined August 2010
United States100 Posts
March 15 2014 01:52 GMT
#16
This looks really cool. Cant wait to try it out. Will you ever try and support things like macro mechanics (IE: larvae injections, avg energy on CC / nexus) and screens switches per minute like scelite?
Xorphene
Profile Joined January 2011
United Kingdom492 Posts
March 15 2014 02:05 GMT
#17
This is ridiculously cool, talk about a fantastic tool to monitor personal performance and improve.

Great work.
T: Polt, Fantasy, Flash, Jjakji. P: HerO, Rain, Grubby, SoS. Z: Jaedong, Scarlett, Snute, Life. Casters: ToD, Apollo, MrBitter, Artosis, Day[9].
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 15 2014 15:39 GMT
#18
On March 15 2014 10:52 Valeranth wrote:
This looks really cool. Cant wait to try it out. Will you ever try and support things like macro mechanics (IE: larvae injections, avg energy on CC / nexus) and screens switches per minute like scelite?

Potentially. At the moment, I'm more interested in high level analysis, such as builds, building placements, engagement locations, etc.

However, all the information is available from the replays, as you said. If I can find a way to make that easily viewable over a large number of matches, I'll definitely be getting that in there, too.
I will reduce you to a series of numbers.
-HuShang-
Profile Joined December 2012
Canada393 Posts
March 18 2014 02:00 GMT
#19
Can i copy paste the build order :D? It'd be wicked cool if I could play through a game and then upload it into here and grab the build order.
Professional Starcraft 2 Coach & Caster | Message me for more info or business proposals
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 18 2014 16:15 GMT
#20
Nice idea. I'll can't see why not.
I will reduce you to a series of numbers.
1 2 3 Next All
Please log in or register to reply.
Live Events Refresh
WardiTV Korean Royale
12:00
Open Qualifier #2
WardiTV232
LiquipediaDiscussion
Replay Cast
09:00
Crank Gathers S2: Playoffs D4
CranKy Ducklings222
LiquipediaDiscussion
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Livibee 82
StarCraft: Brood War
Sea 21280
Rain 8380
Bisu 2602
Pusan 517
Stork 372
Last 228
Hyuk 203
Leta 147
Barracks 140
ToSsGirL 122
[ Show more ]
Liquid`Ret 46
Aegong 45
Sharp 42
JulyZerg 29
zelot 24
Icarus 22
sas.Sziky 18
Yoon 16
Free 15
Terrorterran 2
Dota 2
XcaliburYe997
Counter-Strike
x6flipin424
edward33
Super Smash Bros
Mew2King63
Other Games
singsing1526
B2W.Neo337
crisheroes286
Pyrionflax239
Fuzer 170
XaKoH 138
Happy112
SortOf106
Organizations
Counter-Strike
PGL108
StarCraft: Brood War
lovetv 13
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 15 non-featured ]
StarCraft 2
• StrangeGG 73
• LUISG 32
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• LaughNgamezSOOP
• Migwel
• sooper7s
StarCraft: Brood War
• iopq 2
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
League of Legends
• Jankos2712
• Stunt628
Upcoming Events
LAN Event
2h 39m
OSC
10h 39m
The PondCast
21h 39m
LAN Event
1d 2h
Replay Cast
1d 10h
OSC
1d 23h
LAN Event
2 days
Korean StarCraft League
2 days
CranKy Ducklings
2 days
WardiTV Korean Royale
2 days
[ Show More ]
LAN Event
3 days
IPSL
3 days
dxtr13 vs OldBoy
Napoleon vs Doodle
Replay Cast
3 days
Sparkling Tuna Cup
3 days
WardiTV Korean Royale
3 days
LAN Event
4 days
IPSL
4 days
JDConan vs WIZARD
WolFix vs Cross
Replay Cast
4 days
Wardi Open
4 days
WardiTV Korean Royale
5 days
Replay Cast
6 days
Kung Fu Cup
6 days
Classic vs Solar
herO vs Cure
Reynor vs GuMiho
ByuN vs ShoWTimE
Liquipedia Results

Completed

BSL 21 Points
SC4ALL: StarCraft II
Eternal Conflict S1

Ongoing

C-Race Season 1
IPSL Winter 2025-26
KCM Race Survival 2025 Season 4
SOOP Univ League 2025
YSL S2
IEM Chengdu 2025
PGL Masters Bucharest 2025
Thunderpick World Champ.
CS Asia Championships 2025
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025

Upcoming

BSL Season 21
SLON Tour Season 2
BSL 21 Non-Korean Championship
Acropolis #4
HSC XXVIII
RSL Offline Finals
WardiTV 2025
RSL Revival: Season 3
Stellar Fest
META Madness #9
BLAST Bounty Winter 2026: Closed Qualifier
eXTREMESLAND 2025
ESL Impact League Season 8
SL Budapest Major 2025
BLAST Rivals Fall 2025
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.