• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 18:02
CEST 00:02
KST 07:02
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
Classic Games #3: Rogue vs Serral at BlizzCon9[ASL20] Ro16 Preview Pt1: Ascent10Maestros of the Game: Week 1/Play-in Preview12[ASL20] Ro24 Preview Pt2: Take-Off7[ASL20] Ro24 Preview Pt1: Runway13
Community News
SC4ALL $6,000 Open LAN in Philadelphia7Weekly Cups (Sept 1-7): MaxPax rebounds & Clem saga continues29LiuLi Cup - September 2025 Tournaments3Weekly Cups (August 25-31): Clem's Last Straw?39Weekly Cups (Aug 18-24): herO dethrones MaxPax6
StarCraft 2
General
Weekly Cups (Sept 1-7): MaxPax rebounds & Clem saga continues #1: Maru - Greatest Players of All Time Team Liquid Map Contest #21 - Presented by Monster Energy Classic Games #3: Rogue vs Serral at BlizzCon What happened to Singapore/Brazil servers?
Tourneys
Maestros of The Game—$20k event w/ live finals in Paris RSL: Revival, a new crowdfunded tournament series WardiTV TL Team Map Contest #5 Tournaments Sparkling Tuna Cup - Weekly Open Tournament SC4ALL $6,000 Open LAN in Philadelphia
Strategy
Custom Maps
External Content
Mutation # 491 Night Drive Mutation # 490 Masters of Midnight Mutation # 489 Bannable Offense Mutation # 488 What Goes Around
Brood War
General
Pros React To: SoulKey's 5-Peat Challenge BGH Auto Balance -> http://bghmmr.eu/ BW General Discussion ASL20 General Discussion BSL Team Wars - Bonyth, Dewalt, Hawk & Sziky teams
Tourneys
[IPSL] ISPL Season 1 Winter Qualis and Info! Is there English video for group selection for ASL [ASL20] Ro16 Group B [ASL20] Ro16 Group A
Strategy
Simple Questions, Simple Answers Muta micro map competition Fighting Spirit mining rates [G] Mineral Boosting
Other Games
General Games
Stormgate/Frost Giant Megathread Borderlands 3 Nintendo Switch Thread Path of Exile General RTS Discussion Thread
Dota 2
Official 'what is Dota anymore' discussion LiquidDota to reintegrate into TL.net
League of Legends
Heroes of the Storm
Simple Questions, Simple Answers Heroes of the Storm 2.0
Hearthstone
Heroes of StarCraft mini-set
TL Mafia
TL Mafia Community Thread
Community
General
Canadian Politics Mega-thread US Politics Mega-thread Russo-Ukrainian War Thread The Big Programming Thread Things Aren’t Peaceful in Palestine
Fan Clubs
The Happy Fan Club!
Media & Entertainment
Movie Discussion! [Manga] One Piece Anime Discussion Thread
Sports
2024 - 2026 Football Thread Formula 1 Discussion MLB/Baseball 2023
World Cup 2022
Tech Support
Linksys AE2500 USB WIFI keeps disconnecting Computer Build, Upgrade & Buying Resource Thread High temperatures on bridge(s)
TL Community
BarCraft in Tokyo Japan for ASL Season5 Final The Automated Ban List
Blogs
The Personality of a Spender…
TrAiDoS
A very expensive lesson on ma…
Garnet
hello world
radishsoup
Lemme tell you a thing o…
JoinTheRain
RTS Design in Hypercoven
a11
Evil Gacha Games and the…
ffswowsucks
Customize Sidebar...

Website Feedback

Closed Threads



Active: 1273 users

Quantitative Analysis Tool

Forum Index > SC2 General
Post a Reply
1 2 3 Next All
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
Last Edited: 2014-03-11 21:21:52
March 11 2014 21:15 GMT
#1
Hello everyone!

It's WALL OF TEXT AND PICTURES TIME

Forward TL;DR
What I've created thus far is just a hodge-podge of random stuff I've found I can garner from replays these days, as well as what what I think people could find useful with them.
This is meant to answer a set of questions about large numbers of games of StarCraft.

Before I go any further: Shoutouts to TLO for letting me use all his ladder games. What you're seeing is information from his last 380 ladder games.

Introduction (you could skip this bit I suppose!):
I've made a few posts in the past saying "HEY LOOK AT WHAT I'VE DONE!" only to have something come along and stop it working (see http://www.teamliquid.net/forum/starcraft-2/309211-starcraft-map-analysis-stargraphed).
So, naturally, I decided to do it again.

This time, with the 2.0.8 patch last year, I found out that a lot more information was stored in replays. In the past it was just raw user inputs that was simulated in the game when you ran the replay.
However, now this is not the case. You have seen with things like SCELight that you can get the buildings you created, upgrades made, etc. With tools like that giving you qualitative analysis of each of your games, and sites such as Aligulac giving you quantitative analysis of players and how they do in tournaments, I thought maybe I could combine the two. Turns out, I can!

I started out thinking that, if tournaments release their replays, I can grab all the games from all the players and use this to profile them. Create an overview of this player in a tournament setting. Could I use this to predict what they would do on any given map in a given matchup? Could I say "Ziggy says there's a 74% chance that MC will go quick stargate on this map vs Zerg"? Well, maybe, but as I was working on it and talking to some people about it, it turned out that we could turn this into a training tool, or in fact a tool that could actually do quite a few things.
Introduction over

Parsing Replays:
This tool uses Blizzard's S2 Protocol (https://github.com/Blizzard/s2protocol - Thanks, Blizzard!). I have not written my own replay parsing engine as of yet. I might do it I get the time and/or inclination to do so. As for now, this tool provides what I'm after doing!

It takes ~ 15-60 seconds to parse a replay based on time. Because of this, Replays are then stored off in a format that just keeps track of what I'm interested in. This means I can load replays much faster after they've been parsed. I do this because, unlike qualitative tools, I'm not interested in how you hotkey your army. I'm just here to give you STATS ABOUT ALL YOUR GAMES AT ONCE. RIGHT TO YOUR FACE.

Player Matchup Overviews:
You want to know how well you've been doing in each of your matchups? NO PROBLEM!
[image loading]
Obviously I have no real information from the last 2-7 days, because he's been at SSC
So far so Aligulac, but there's more!

Build Orders:
"What does a build look like?"

I have included the ability to configure build orders.
[image loading]
With this you can fill in any length of build, beginning and ending at any point. This is a build where Zerg goes onto 3 bases, at least one queen per base, gets a reasonably fast ling speed (7 minutes) and at least 24 drones.

When configuring the build, each section has its own start/end point. If you wanted to, you could add another 8 lings that start and end at a different point, it's all good.

Or you could use it to filter replays based on whether a roach warren was built at all:
[image loading]

Player Build Overviews:
"What do my games look like?"
A straight up look at how your games have been
[image loading]

Can be toggled to show upgrades/units, too!
[image loading]

I tried to add some extra information and functionality to this, so -
Want to see the times instead of food values for these, and group them up to the first 7:30? YOU SURE CAN!
[image loading]

It will also give you information in each grouped build item. You can see first/average/latest time they were placed:
[image loading]

As you can see, it gives you your overall win percentage, as well as the lengths of all the games you've played. On the right, you can see it copies that information. This is actually updated based on which of the replays you've selected, as such:
[image loading]

From this we can see that TLO's 3 post common builds up to the 7:30 mark actually give him a slightly higher win rate than anything else.
It is also possible to filter by map as well.

You can see a bunch of strings on the right under the filtered win percentages. Those are all the replays that correspond to the highlighted rows. If you have access to them and they are in the location from which they are parsed, you can copy them off to another folder for a closer look, if you so like.

Why would you do this? It's possible to filter, as you can see in the top right, based on your saved build order configurations. Useful if you want to practice a build and copy out your games where you've done them. You can tag replays, too, which will allow you to easily filter those replays in future.

Build Order Scoring:
"How good am I getting at this build?"
This one is very much a work in progress. Is it possible to rate how well you do a build? Still in the process of finding out, but this is what I have so far:
[image loading]

So, you can pick a player and a build and it'll show information on that build. You can see the best, average and worst times for any replay that fulfils the build order criteria. This extends to each element of the build.

The graphs show:
1) The completion times and how often that time is hit, as well as how many of those games you win with.
2) The time at which you completed the build over... time. If you see what I mean.

On the right you can see the "best" values for each build. The bottom right allows you to compare an unparsed replay. If it contains the build you're filtering against it'll show you where it comes in relation to the already parsed replays. COMPARE YOURSELF TO THE PROS, YO.

Build Order Wars:
"What should I be doing against X?"
Something that is generally already known, but comparison of build orders.
Some basic ones: 3 base zerg (3 hatches before 8 minutes) vs 3 base Protoss (3 nexuses before 10 minutes):
[image loading]

Zerg wins 53 out of 85 of these games. you can see how the matchup swings back and forth over time. I have no idea why. This, I think, is just straight up for numbers. We never see enough numbers in StarCraft casts.
One thing you saw in the first link I showed was a heatmap. I bet you're all wondering where those are. FEAR NOT!

Heat Maps:
That's right. I have heat maps for two different kinds of things.
Buildings:
[image loading]

You can filter by map, matchup, spawn location, building type, replay filter.
You want to know where protoss builds proxy pylons before the 9 minute mark on Daedelus, when they spawn top left? I GOT YOU, BRO.
[image loading]

Obviously this is going to be a really small subset of games, hence there aren't many (it's all Protoss vs TLO games on this map!)
As well as being useful to know where people are building proxy pylons at you, you can see the glory that is where all the units have died.
[image loading]

This can, again, be filtered in the same way (except not by building, that would be odd).
Aspiring map makers may be able to use this to make sure that fights are varied and spread over the map, that all bases are taken where possible and that it's not just all focused on one area the whole time.
I'm basically just asking you not make Habitation Station
[image loading]
The "All Mid" of SC2 Maps

Anyway, that's all I've got so far:
Pre-Emptive Answers
It's rather ugly
Yes, I know it's not very pretty. I'm bad at art based stuff, and I basically learned WPF as I was making this, so it's a bit sloppy in places. However, it works!

Can I use this?
I'll be potentially releasing this for use in the next couple of weeks. I'll bundle everything that you would need to use to run it where I can. However, you will most likely need to install Python (2.7) yourself to make it work. This is to run S2Protocol. This requirement will possibly be removed in later iterations if I can get the time to write my own replay parsing engine.

That's a dumb name
I can't think fo a better one. I've already used StarGraphed. Maybe "StarGraphed: The Next Generation" and I could rename all the buttons that do things to "Make It So"

Feel free to hit me up here on a PM or grab me on Twitter @Gowerly if you have any questions or suggestions. I'll add the most common ones to the OP here.

Thanks for reading!
I will reduce you to a series of numbers.
Liquid`Snute
Profile Blog Joined July 2010
Norway839 Posts
March 11 2014 21:21 GMT
#2
sick
Team Liquid
MrMedic
Profile Joined November 2010
Canada452 Posts
March 11 2014 21:27 GMT
#3
This is pretty sweet! nice work, I'd love to use this.
RHWY
Profile Blog Joined December 2011
Ireland43 Posts
March 11 2014 21:33 GMT
#4
Hi Dave, Robert here, I was wondering what you are going to do next? Do I have to use my own replays or can I use replays from pro players and tournaments too?

@es_performance @LiquidTLO @LiquidRet
MilLorD
Profile Joined September 2011
Germany36 Posts
March 11 2014 21:33 GMT
#5
Amazing work!
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 11 2014 21:40 GMT
#6
On March 12 2014 06:33 Yapa wrote:
Hi Dave, Robert here, I was wondering what you are going to do next? Do I have to use my own replays or can I use replays from pro players and tournaments too?


You can set it up to automatically parse any replays that are added to a folder, so it's always up to date with your laddering progress.

You can also get it to just parse a bunch of replays in a folder, too. They don't have to be yours (as you can see by me using TLO's) they just have to be replays.

I'm hoping to grab replays from SSC (if they're released) and/or IEM and doing some analysis on them.
I'm looking to get things like

Most common proxy locations (rax, pylons, etc)
From this I'm hoping to be able to figure out the best scouting routes to check for these things

Most used builds/Most successful builds
Which builds were used the most and which were the most successful? Which matchup outcomes changed the most over the duration of a game?

Anything that warrants discussion
Do we see that Zergs end up being defensive?
Maybe that Protoss vs Terran ends up with a slow push from the Terran base to Protoss'?

I think there's a lot that can be discussed by looking at a lot of replays. I'm hoping to get the chance to do that!

Go Take, release replays! :D:D
I will reduce you to a series of numbers.
BronzElite
Profile Joined November 2011
Germany29 Posts
March 12 2014 08:58 GMT
#7
Oh my God! All of TLO's secrets out in the Open!!!!111eleven

Seriously, great work! Nice to hear that even Blizz themselves are now giving some official attention to data mining SC2 replays. But just as with StarGraphed, all credit goes to you for turning raw data into insight. Beautiful!
AchillesStarcraft
Profile Joined March 2014
United States1 Post
March 12 2014 15:52 GMT
#8
This is awesome!! Very informative read
great work man.
https://www.youtube.com/user/AchillesStarcraft
Pirfiktshon
Profile Joined June 2013
United States1072 Posts
Last Edited: 2014-03-12 16:09:04
March 12 2014 16:07 GMT
#9
I am .... speechless.... this is so beautiful I need a minute ...............................................................

Ok, just 1 question why can't I have this now? and will I have to purchase?
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 12 2014 16:11 GMT
#10
I need to finish up some steps:
- I don't have pictures for all the maps and it's tedious using the map editor to get them all
- I need to make sure I can't make it crash by doing things like mashing buttons or something. I'd like to make sure that when it's released I don't get 50% of the people using it saying "My PC exploded and now there's metal in my face" or something.

Also, it'll be free. I'm not looking to make any money from this. I just thought it was something cool to do.
I will reduce you to a series of numbers.
Grovbolle
Profile Blog Joined July 2011
Denmark3806 Posts
Last Edited: 2014-03-12 16:49:43
March 12 2014 16:22 GMT
#11
I just came.

Also, I approve of the phrase: "So far so Aligulac"
Lies, damned lies and statistics: http://aligulac.com
Pirfiktshon
Profile Joined June 2013
United States1072 Posts
March 12 2014 16:24 GMT
#12
Well Gowerly if there is anything I can do to help like try do the beta for you or anything else you need just let me know
Sikian
Profile Blog Joined September 2011
Spain177 Posts
March 12 2014 16:34 GMT
#13
This tickles my statistical representation hormones.
Helping Starbow :: a.k.a. SoaH
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 12 2014 23:31 GMT
#14
Thanks to iHiro for this one:
I should be able to have this work for Starbow maps as well. It should take a little bit of modification to work with the new unit types.
There was an invitational that was done recently with it, so I will try to do some small analysis on those games.
I'll post more when it's done.
I will reduce you to a series of numbers.
vult
Profile Blog Joined February 2012
United States9400 Posts
March 12 2014 23:44 GMT
#15
This is so sick, thank you for this!
I used to play random, but for you I play very specifically.
Valeranth
Profile Joined August 2010
United States100 Posts
March 15 2014 01:52 GMT
#16
This looks really cool. Cant wait to try it out. Will you ever try and support things like macro mechanics (IE: larvae injections, avg energy on CC / nexus) and screens switches per minute like scelite?
Xorphene
Profile Joined January 2011
United Kingdom492 Posts
March 15 2014 02:05 GMT
#17
This is ridiculously cool, talk about a fantastic tool to monitor personal performance and improve.

Great work.
T: Polt, Fantasy, Flash, Jjakji. P: HerO, Rain, Grubby, SoS. Z: Jaedong, Scarlett, Snute, Life. Casters: ToD, Apollo, MrBitter, Artosis, Day[9].
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 15 2014 15:39 GMT
#18
On March 15 2014 10:52 Valeranth wrote:
This looks really cool. Cant wait to try it out. Will you ever try and support things like macro mechanics (IE: larvae injections, avg energy on CC / nexus) and screens switches per minute like scelite?

Potentially. At the moment, I'm more interested in high level analysis, such as builds, building placements, engagement locations, etc.

However, all the information is available from the replays, as you said. If I can find a way to make that easily viewable over a large number of matches, I'll definitely be getting that in there, too.
I will reduce you to a series of numbers.
-HuShang-
Profile Joined December 2012
Canada393 Posts
March 18 2014 02:00 GMT
#19
Can i copy paste the build order :D? It'd be wicked cool if I could play through a game and then upload it into here and grab the build order.
Professional Starcraft 2 Coach & Caster | Message me for more info or business proposals
Gowerly
Profile Blog Joined July 2011
United Kingdom916 Posts
March 18 2014 16:15 GMT
#20
Nice idea. I'll can't see why not.
I will reduce you to a series of numbers.
1 2 3 Next All
Please log in or register to reply.
Live Events Refresh
BSL Team Wars
19:00
Playoff - 4th vs 3rd
Team Bonyth vs Team Sziky
ZZZero.O78
LiquipediaDiscussion
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
JuggernautJason127
Nathanias 61
Lillekanin 11
StarCraft: Brood War
Britney 1878
ZZZero.O 78
sSak 32
Artosis 23
NaDa 16
Dota 2
NeuroSwarm118
LuMiX1
Counter-Strike
fl0m1566
Stewie2K538
Heroes of the Storm
Liquid`Hasu546
Other Games
Grubby3741
FrodaN2523
ToD406
SortOf358
Sick189
KnowMe185
Organizations
Other Games
BasetradeTV36
StarCraft 2
Blizzard YouTube
StarCraft: Brood War
BSLTrovo
sctven
[ Show 20 non-featured ]
StarCraft 2
• musti20045 42
• RyuSc2 42
• StrangeGG 37
• Sammyuel 7
• LaughNgamezSOOP
• AfreecaTV YouTube
• sooper7s
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• HerbMon 22
• RayReign 1
• STPLYoutube
• ZZZeroYoutube
• BSLYoutube
Dota 2
• masondota22510
League of Legends
• Doublelift5331
Other Games
• imaqtpie1191
• Scarra985
Upcoming Events
Afreeca Starleague
11h 58m
Snow vs Sharp
Jaedong vs Mini
Wardi Open
12h 58m
OSC
1d 1h
Sparkling Tuna Cup
1d 11h
Afreeca Starleague
1d 11h
Light vs Speed
Larva vs Soma
PiGosaur Monday
2 days
LiuLi Cup
2 days
RSL Revival
3 days
Maru vs Reynor
Cure vs TriGGeR
The PondCast
3 days
RSL Revival
4 days
Zoun vs Classic
[ Show More ]
Korean StarCraft League
5 days
RSL Revival
5 days
[BSL 2025] Weekly
5 days
BSL Team Wars
5 days
RSL Revival
6 days
Online Event
6 days
Liquipedia Results

Completed

Proleague 2025-09-10
SEL Season 2 Championship
HCC Europe

Ongoing

BSL 20 Team Wars
KCM Race Survival 2025 Season 3
BSL 21 Points
ASL Season 20
CSL 2025 AUTUMN (S18)
LASL Season 20
RSL Revival: Season 2
Maestros of the Game
FISSURE Playground #2
BLAST Open Fall 2025
BLAST Open Fall Qual
Esports World Cup 2025
BLAST Bounty Fall 2025
BLAST Bounty Fall Qual
IEM Cologne 2025
FISSURE Playground #1

Upcoming

2025 Chongqing Offline CUP
BSL Polish World Championship 2025
IPSL Winter 2025-26
BSL Season 21
SC4ALL: Brood War
BSL 21 Team A
SC4ALL: StarCraft II
EC S1
SL Budapest Major 2025
BLAST Rivals Fall 2025
IEM Chengdu 2025
PGL Masters Bucharest 2025
Thunderpick World Champ.
MESA Nomadic Masters Fall
CS Asia Championships 2025
ESL Pro League S22
StarSeries Fall 2025
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2025 TLnet. All Rights Reserved.