• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 13:37
CEST 19:37
KST 02:37
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Power Rank - Esports World Cup 202529RSL Season 1 - Final Week8[ASL19] Finals Recap: Standing Tall15HomeStory Cup 27 - Info & Preview18Classic wins Code S Season 2 (2025)16
Community News
Weekly Cups (July 14-20): Final Check-up0Esports World Cup 2025 - Brackets Revealed19Weekly Cups (July 7-13): Classic continues to roll8Team TLMC #5 - Submission re-extension4Firefly given lifetime ban by ESIC following match-fixing investigation17
StarCraft 2
General
The GOAT ranking of GOAT rankings Power Rank - Esports World Cup 2025 RSL Revival patreon money discussion thread Esports World Cup 2025 - Final Player Roster Why doesnt SC2 scene costream tournaments
Tourneys
Esports World Cup 2025 Sparkling Tuna Cup - Weekly Open Tournament Sea Duckling Open (Global, Bronze-Diamond) FEL Cracov 2025 (July 27) - $8000 live event RSL: Revival, a new crowdfunded tournament series
Strategy
How did i lose this ZvP, whats the proper response
Custom Maps
External Content
Mutation # 483 Kill Bot Wars Mutation # 482 Wheel of Misfortune Mutation # 481 Fear and Lava Mutation # 480 Moths to the Flame
Brood War
General
BW General Discussion Flash Announces (and Retracts) Hiatus From ASL BGH Auto Balance -> http://bghmmr.eu/ Corsair Pursuit Micro? Pro gamer house photos
Tourneys
[Megathread] Daily Proleagues [BSL 2v2] ProLeague Season 3 - Friday 21:00 CET The Casual Games of the Week Thread BWCL Season 63 Announcement
Strategy
Simple Questions, Simple Answers I am doing this better than progamers do.
Other Games
General Games
Nintendo Switch Thread Stormgate/Frost Giant Megathread [MMORPG] Tree of Savior (Successor of Ragnarok) Path of Exile CCLP - Command & Conquer League Project
Dota 2
Official 'what is Dota anymore' discussion
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread Vanilla Mini Mafia
Community
General
US Politics Mega-thread Things Aren’t Peaceful in Palestine Russo-Ukrainian War Thread The Games Industry And ATVI Stop Killing Games - European Citizens Initiative
Fan Clubs
SKT1 Classic Fan Club! Maru Fan Club
Media & Entertainment
Anime Discussion Thread Movie Discussion! [Manga] One Piece Korean Music Discussion [\m/] Heavy Metal Thread
Sports
2024 - 2025 Football Thread Formula 1 Discussion TeamLiquid Health and Fitness Initiative For 2023 NBA General Discussion
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
The Automated Ban List
Blogs
Ping To Win? Pings And Their…
TrAiDoS
momentary artworks from des…
tankgirl
from making sc maps to makin…
Husyelt
StarCraft improvement
iopq
Socialism Anyone?
GreenHorizons
Customize Sidebar...

Website Feedback

Closed Threads



Active: 910 users

Quantitative Analysis Tool

Forum Index > SC2 General
Post a Reply
1 2 3 Next All
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
Last Edited: 2014-03-11 21:21:52
March 11 2014 21:15 GMT
#1
Hello everyone!

It's WALL OF TEXT AND PICTURES TIME

Forward TL;DR
What I've created thus far is just a hodge-podge of random stuff I've found I can garner from replays these days, as well as what what I think people could find useful with them.
This is meant to answer a set of questions about large numbers of games of StarCraft.

Before I go any further: Shoutouts to TLO for letting me use all his ladder games. What you're seeing is information from his last 380 ladder games.

Introduction (you could skip this bit I suppose!):
I've made a few posts in the past saying "HEY LOOK AT WHAT I'VE DONE!" only to have something come along and stop it working (see http://www.teamliquid.net/forum/starcraft-2/309211-starcraft-map-analysis-stargraphed).
So, naturally, I decided to do it again.

This time, with the 2.0.8 patch last year, I found out that a lot more information was stored in replays. In the past it was just raw user inputs that was simulated in the game when you ran the replay.
However, now this is not the case. You have seen with things like SCELight that you can get the buildings you created, upgrades made, etc. With tools like that giving you qualitative analysis of each of your games, and sites such as Aligulac giving you quantitative analysis of players and how they do in tournaments, I thought maybe I could combine the two. Turns out, I can!

I started out thinking that, if tournaments release their replays, I can grab all the games from all the players and use this to profile them. Create an overview of this player in a tournament setting. Could I use this to predict what they would do on any given map in a given matchup? Could I say "Ziggy says there's a 74% chance that MC will go quick stargate on this map vs Zerg"? Well, maybe, but as I was working on it and talking to some people about it, it turned out that we could turn this into a training tool, or in fact a tool that could actually do quite a few things.
Introduction over

Parsing Replays:
This tool uses Blizzard's S2 Protocol (https://github.com/Blizzard/s2protocol - Thanks, Blizzard!). I have not written my own replay parsing engine as of yet. I might do it I get the time and/or inclination to do so. As for now, this tool provides what I'm after doing!

It takes ~ 15-60 seconds to parse a replay based on time. Because of this, Replays are then stored off in a format that just keeps track of what I'm interested in. This means I can load replays much faster after they've been parsed. I do this because, unlike qualitative tools, I'm not interested in how you hotkey your army. I'm just here to give you STATS ABOUT ALL YOUR GAMES AT ONCE. RIGHT TO YOUR FACE.

Player Matchup Overviews:
You want to know how well you've been doing in each of your matchups? NO PROBLEM!
[image loading]
Obviously I have no real information from the last 2-7 days, because he's been at SSC
So far so Aligulac, but there's more!

Build Orders:
"What does a build look like?"

I have included the ability to configure build orders.
[image loading]
With this you can fill in any length of build, beginning and ending at any point. This is a build where Zerg goes onto 3 bases, at least one queen per base, gets a reasonably fast ling speed (7 minutes) and at least 24 drones.

When configuring the build, each section has its own start/end point. If you wanted to, you could add another 8 lings that start and end at a different point, it's all good.

Or you could use it to filter replays based on whether a roach warren was built at all:
[image loading]

Player Build Overviews:
"What do my games look like?"
A straight up look at how your games have been
[image loading]

Can be toggled to show upgrades/units, too!
[image loading]

I tried to add some extra information and functionality to this, so -
Want to see the times instead of food values for these, and group them up to the first 7:30? YOU SURE CAN!
[image loading]

It will also give you information in each grouped build item. You can see first/average/latest time they were placed:
[image loading]

As you can see, it gives you your overall win percentage, as well as the lengths of all the games you've played. On the right, you can see it copies that information. This is actually updated based on which of the replays you've selected, as such:
[image loading]

From this we can see that TLO's 3 post common builds up to the 7:30 mark actually give him a slightly higher win rate than anything else.
It is also possible to filter by map as well.

You can see a bunch of strings on the right under the filtered win percentages. Those are all the replays that correspond to the highlighted rows. If you have access to them and they are in the location from which they are parsed, you can copy them off to another folder for a closer look, if you so like.

Why would you do this? It's possible to filter, as you can see in the top right, based on your saved build order configurations. Useful if you want to practice a build and copy out your games where you've done them. You can tag replays, too, which will allow you to easily filter those replays in future.

Build Order Scoring:
"How good am I getting at this build?"
This one is very much a work in progress. Is it possible to rate how well you do a build? Still in the process of finding out, but this is what I have so far:
[image loading]

So, you can pick a player and a build and it'll show information on that build. You can see the best, average and worst times for any replay that fulfils the build order criteria. This extends to each element of the build.

The graphs show:
1) The completion times and how often that time is hit, as well as how many of those games you win with.
2) The time at which you completed the build over... time. If you see what I mean.

On the right you can see the "best" values for each build. The bottom right allows you to compare an unparsed replay. If it contains the build you're filtering against it'll show you where it comes in relation to the already parsed replays. COMPARE YOURSELF TO THE PROS, YO.

Build Order Wars:
"What should I be doing against X?"
Something that is generally already known, but comparison of build orders.
Some basic ones: 3 base zerg (3 hatches before 8 minutes) vs 3 base Protoss (3 nexuses before 10 minutes):
[image loading]

Zerg wins 53 out of 85 of these games. you can see how the matchup swings back and forth over time. I have no idea why. This, I think, is just straight up for numbers. We never see enough numbers in StarCraft casts.
One thing you saw in the first link I showed was a heatmap. I bet you're all wondering where those are. FEAR NOT!

Heat Maps:
That's right. I have heat maps for two different kinds of things.
Buildings:
[image loading]

You can filter by map, matchup, spawn location, building type, replay filter.
You want to know where protoss builds proxy pylons before the 9 minute mark on Daedelus, when they spawn top left? I GOT YOU, BRO.
[image loading]

Obviously this is going to be a really small subset of games, hence there aren't many (it's all Protoss vs TLO games on this map!)
As well as being useful to know where people are building proxy pylons at you, you can see the glory that is where all the units have died.
[image loading]

This can, again, be filtered in the same way (except not by building, that would be odd).
Aspiring map makers may be able to use this to make sure that fights are varied and spread over the map, that all bases are taken where possible and that it's not just all focused on one area the whole time.
I'm basically just asking you not make Habitation Station
[image loading]
The "All Mid" of SC2 Maps

Anyway, that's all I've got so far:
Pre-Emptive Answers
It's rather ugly
Yes, I know it's not very pretty. I'm bad at art based stuff, and I basically learned WPF as I was making this, so it's a bit sloppy in places. However, it works!

Can I use this?
I'll be potentially releasing this for use in the next couple of weeks. I'll bundle everything that you would need to use to run it where I can. However, you will most likely need to install Python (2.7) yourself to make it work. This is to run S2Protocol. This requirement will possibly be removed in later iterations if I can get the time to write my own replay parsing engine.

That's a dumb name
I can't think fo a better one. I've already used StarGraphed. Maybe "StarGraphed: The Next Generation" and I could rename all the buttons that do things to "Make It So"

Feel free to hit me up here on a PM or grab me on Twitter @Gowerly if you have any questions or suggestions. I'll add the most common ones to the OP here.

Thanks for reading!
I will reduce you to a series of numbers.
Liquid`Snute
Profile Blog Joined July 2010
Norway839 Posts
March 11 2014 21:21 GMT
#2
sick
Team Liquid
MrMedic
Profile Joined November 2010
Canada452 Posts
March 11 2014 21:27 GMT
#3
This is pretty sweet! nice work, I'd love to use this.
RHWY
Profile Blog Joined December 2011
Ireland43 Posts
March 11 2014 21:33 GMT
#4
Hi Dave, Robert here, I was wondering what you are going to do next? Do I have to use my own replays or can I use replays from pro players and tournaments too?

@es_performance @LiquidTLO @LiquidRet
MilLorD
Profile Joined September 2011
Germany36 Posts
March 11 2014 21:33 GMT
#5
Amazing work!
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 11 2014 21:40 GMT
#6
On March 12 2014 06:33 Yapa wrote:
Hi Dave, Robert here, I was wondering what you are going to do next? Do I have to use my own replays or can I use replays from pro players and tournaments too?


You can set it up to automatically parse any replays that are added to a folder, so it's always up to date with your laddering progress.

You can also get it to just parse a bunch of replays in a folder, too. They don't have to be yours (as you can see by me using TLO's) they just have to be replays.

I'm hoping to grab replays from SSC (if they're released) and/or IEM and doing some analysis on them.
I'm looking to get things like

Most common proxy locations (rax, pylons, etc)
From this I'm hoping to be able to figure out the best scouting routes to check for these things

Most used builds/Most successful builds
Which builds were used the most and which were the most successful? Which matchup outcomes changed the most over the duration of a game?

Anything that warrants discussion
Do we see that Zergs end up being defensive?
Maybe that Protoss vs Terran ends up with a slow push from the Terran base to Protoss'?

I think there's a lot that can be discussed by looking at a lot of replays. I'm hoping to get the chance to do that!

Go Take, release replays! :D:D
I will reduce you to a series of numbers.
BronzElite
Profile Joined November 2011
Germany29 Posts
March 12 2014 08:58 GMT
#7
Oh my God! All of TLO's secrets out in the Open!!!!111eleven

Seriously, great work! Nice to hear that even Blizz themselves are now giving some official attention to data mining SC2 replays. But just as with StarGraphed, all credit goes to you for turning raw data into insight. Beautiful!
AchillesStarcraft
Profile Joined March 2014
United States1 Post
March 12 2014 15:52 GMT
#8
This is awesome!! Very informative read
great work man.
https://www.youtube.com/user/AchillesStarcraft
Pirfiktshon
Profile Joined June 2013
United States1072 Posts
Last Edited: 2014-03-12 16:09:04
March 12 2014 16:07 GMT
#9
I am .... speechless.... this is so beautiful I need a minute ...............................................................

Ok, just 1 question why can't I have this now? and will I have to purchase?
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 12 2014 16:11 GMT
#10
I need to finish up some steps:
- I don't have pictures for all the maps and it's tedious using the map editor to get them all
- I need to make sure I can't make it crash by doing things like mashing buttons or something. I'd like to make sure that when it's released I don't get 50% of the people using it saying "My PC exploded and now there's metal in my face" or something.

Also, it'll be free. I'm not looking to make any money from this. I just thought it was something cool to do.
I will reduce you to a series of numbers.
Grovbolle
Profile Blog Joined July 2011
Denmark3805 Posts
Last Edited: 2014-03-12 16:49:43
March 12 2014 16:22 GMT
#11
I just came.

Also, I approve of the phrase: "So far so Aligulac"
Lies, damned lies and statistics: http://aligulac.com
Pirfiktshon
Profile Joined June 2013
United States1072 Posts
March 12 2014 16:24 GMT
#12
Well Gowerly if there is anything I can do to help like try do the beta for you or anything else you need just let me know
Sikian
Profile Blog Joined September 2011
Spain177 Posts
March 12 2014 16:34 GMT
#13
This tickles my statistical representation hormones.
Helping Starbow :: a.k.a. SoaH
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 12 2014 23:31 GMT
#14
Thanks to iHiro for this one:
I should be able to have this work for Starbow maps as well. It should take a little bit of modification to work with the new unit types.
There was an invitational that was done recently with it, so I will try to do some small analysis on those games.
I'll post more when it's done.
I will reduce you to a series of numbers.
vult
Profile Blog Joined February 2012
United States9400 Posts
March 12 2014 23:44 GMT
#15
This is so sick, thank you for this!
I used to play random, but for you I play very specifically.
Valeranth
Profile Joined August 2010
United States100 Posts
March 15 2014 01:52 GMT
#16
This looks really cool. Cant wait to try it out. Will you ever try and support things like macro mechanics (IE: larvae injections, avg energy on CC / nexus) and screens switches per minute like scelite?
Xorphene
Profile Joined January 2011
United Kingdom492 Posts
March 15 2014 02:05 GMT
#17
This is ridiculously cool, talk about a fantastic tool to monitor personal performance and improve.

Great work.
T: Polt, Fantasy, Flash, Jjakji. P: HerO, Rain, Grubby, SoS. Z: Jaedong, Scarlett, Snute, Life. Casters: ToD, Apollo, MrBitter, Artosis, Day[9].
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 15 2014 15:39 GMT
#18
On March 15 2014 10:52 Valeranth wrote:
This looks really cool. Cant wait to try it out. Will you ever try and support things like macro mechanics (IE: larvae injections, avg energy on CC / nexus) and screens switches per minute like scelite?

Potentially. At the moment, I'm more interested in high level analysis, such as builds, building placements, engagement locations, etc.

However, all the information is available from the replays, as you said. If I can find a way to make that easily viewable over a large number of matches, I'll definitely be getting that in there, too.
I will reduce you to a series of numbers.
-HuShang-
Profile Joined December 2012
Canada393 Posts
March 18 2014 02:00 GMT
#19
Can i copy paste the build order :D? It'd be wicked cool if I could play through a game and then upload it into here and grab the build order.
Professional Starcraft 2 Coach & Caster | Message me for more info or business proposals
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 18 2014 16:15 GMT
#20
Nice idea. I'll can't see why not.
I will reduce you to a series of numbers.
1 2 3 Next All
Please log in or register to reply.
Live Events Refresh
Esports World Cup
10:00
2025 - Day 1
herO vs LancerLIVE!
Cure vs ShoWTimELIVE!
EWC_Arena7054
ComeBackTV 2243
EWC_Arena_22156
TaKeTV 749
Hui .431
3DClanTV 357
CranKy Ducklings215
EnkiAlexander 213
Berry_CruncH210
Rex196
UpATreeSC182
mcanning178
Reynor151
davetesta11
Liquipedia
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
EWC_Arena7054
EWC_Arena_22156
Hui .431
Rex 196
UpATreeSC 182
mcanning 178
Reynor 151
StarCraft: Brood War
Barracks 1112
Bisu 1002
Mini 656
EffOrt 579
Larva 571
Stork 235
Aegong 58
PianO 25
soO 23
scan(afreeca) 18
[ Show more ]
Sharp 17
Movie 12
ivOry 6
JulyZerg 5
League of Legends
Dendi1047
Counter-Strike
fl0m2015
byalli243
oskar176
Heroes of the Storm
Khaldor325
XaKoH 129
Other Games
singsing1912
ceh91879
syndereN213
Trikslyr59
Organizations
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 19 non-featured ]
StarCraft 2
• intothetv
• sooper7s
• Migwel
• AfreecaTV YouTube
• LaughNgamezSOOP
• IndyKCrew
• Kozan
StarCraft: Brood War
• FirePhoenix6
• Michael_bg 4
• STPLYoutube
• ZZZeroYoutube
• BSLYoutube
Dota 2
• C_a_k_e 2655
• masondota2995
• WagamamaTV346
League of Legends
• Nemesis4869
• TFBlade905
Other Games
• imaqtpie631
• Shiphtur378
Upcoming Events
Esports World Cup
16h 23m
Esports World Cup
1d 16h
Esports World Cup
2 days
CranKy Ducklings
3 days
BSL20 Non-Korean Champi…
3 days
CSO Cup
3 days
BSL20 Non-Korean Champi…
4 days
Bonyth vs Sziky
Dewalt vs Hawk
Hawk vs QiaoGege
Sziky vs Dewalt
Mihu vs Bonyth
Zhanhun vs QiaoGege
QiaoGege vs Fengzi
FEL
4 days
BSL20 Non-Korean Champi…
4 days
BSL20 Non-Korean Champi…
5 days
Bonyth vs Zhanhun
Dewalt vs Mihu
Hawk vs Sziky
Sziky vs QiaoGege
Mihu vs Hawk
Zhanhun vs Dewalt
Fengzi vs Bonyth
[ Show More ]
Sparkling Tuna Cup
6 days
Online Event
6 days
Liquipedia Results

Completed

CSL Xiamen Invitational
Championship of Russia 2025
Murky Cup #2

Ongoing

Copa Latinoamericana 4
Jiahua Invitational
BSL20 Non-Korean Championship
Esports World Cup 2025
CC Div. A S7
Underdog Cup #2
FISSURE Playground #1
BLAST.tv Austin Major 2025
ESL Impact League Season 7
IEM Dallas 2025
PGL Astana 2025
Asian Champions League '25

Upcoming

CSLPRO Last Chance 2025
CSLPRO Chat StarLAN 3
BSL Season 21
RSL Revival: Season 2
SEL Season 2 Championship
uThermal 2v2 Main Event
FEL Cracov 2025
HCC Europe
ESL Pro League S22
StarSeries Fall 2025
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
IEM Cologne 2025
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.