|
Ever wonder Who is Who in ICCup Season x?
Ladies and gentlemen, please allow me to present this to Starcraft enthusiasts all over the world. I present it with the wish that the original Starcraft lives far beyond the inception of Starcraft 2 and that we will have many more chances in the future to utilize this tool.
I've mentioned in my previous blog posts that I've been working on an automated replay identifier. I've used Support Vector Machines and sophisticated machine learning tools to tackle this problem. However, I've re-evaluated the problem and I've come up with something simpler. I gave up trying to program a machine that is able to identify a player with 100% accuracy. It now presents a list of results that the human must interpret.
Throughout the process, romad has always been a source of inspiration, though he is probably not aware of it. He is the proof that a replay identifier is possible. Perhaps his ability to identify who's who in a replay is nothing short of genius, something akin to humans recognizing patterns in a game of Go. However, with the hopes that his ability can be turned into an algorithm, I kept myself on track.
I present to you INTREPID.
intrepid
characterized by resolute fearlessness, fortitude, and endurance
It is the INTeractive REPlay IDentifier.
Now, I do not claim that its accuracy comes anywhere near the identifying prowess of romad. In fact, it currently does pretty damn terribly.
Where it's at
=====================================================
=====================================================
>>>> INTREPID <<<<
=====================================================
=====================================================
It's in its infant stages and it works somewhat decently. Because of its inadequacies, it is currently only very good at identifying certain players.
It's quite peculiar. It's good at identifying players with very unique signatures, such as IdrA. He has an incredibly unique signature.
I am completely confident that it can detect IdrA replays. You can download the recent IdrA vs. ret replay and upload it to see the result: http://files.getdropbox.com/u/4422/replays/sleepwalker.rep.
I'll go through the process in case you're confused at the results. As mentioned earlier, the results require human analysis.
1. Upload the replay. You'll see the following.
2. Click Analyze to the right of SleepWalker. You'll see the following.
3. There are four categories. Building hotkeys, hotkey actions, hotkey spam, and hotkey assignments. Roughly speaking, each list is a list of players whose hotkeys come close to SleepWalker's hotkeys.
Building Hotkeys = assigning 1 to Command Center, 2 to Barracks, etc.
Hotkey Actions = does the player 1a2a3a or 4a5a6a?
Hotkey Spam = what sequence of hotkeys does the player love to repeat? 515251525125? or 232323232323?
Hotkey Assignments = what hotkeys are used at all by the player?
The "Total" combines all the categories into one easy-to-read list. As you can see, idra trumps all other players in similarity to SleepWalker.
Also, each player in the list is accompanied by a similarity rating.
Where does the player list come from?
I have a few thousand replays gathered mostly from TSL. I have a few dozen progamer replays that I've picked up from TL and other places. Whenever you upload a replay, it is compared to the database I have.
How to use
1) I cannot emphasize enough that in its current state, it is probably about 25-romad (in the sense that it is 25% close to romad-level detection). I don't think we can ever replace romad for accurate replay detection, but with this, a lot of unique key signatures CAN be detected with a fairly high accuracy (e.g. IdrA, TT1, and some others I found to be unique).
2) I'd say that a "Total similarity" rating of less than 0.5 is pretty much guaranteed equivalence. In the SleepWalker replay, the player Idra shows a < 0.5 total similarity to SleepWalker, strongly suggesting that SleepWalker = Idra. Furthermore, the vast majority of the top 50 results in Total is Idra.
3) I must emphasize that just because someone is at the top does not mean that the player is that someone. You must take the similarity into account. In fact, someone might take up the majority of the top 50 results in Total similarity. Even then, you cannot be certain. If the closest player's similarity rating is a 5, that's a pretty terrible similarity rating. The conclusion is that the INTREPID has no clue as to who it is.
Current problems
1) My server uses a 64-bit machine. RepASM, which I am using to analyze replays, was written for 32-bit. Therefore, some replays simply will not produce any results. You can tell because the page will finish load after pressing Analyze and you won't see anything.
2) RepASM has a few deficiencies. I cannot tell which unit is which. I have to detective work (did this unit just build an scv? then it must be the command center). Sometimes, it's impossible to determine the identity of a unit. For example, I can't tell whether a unit is a ComSat station or not because no special ability uses are recorded by RepASM. Thus, one major deficiency is that ComSat hotkeys are completely ignored.
3) I don't have enough progamer replays. In general, it improves the identifier to have more progamer replays. One reason is that the more there is for a player, the more likely it is that I have samples of different build orders. The other reason is that every player has small deviations. To have a greater sample set means that we can estimate the true "signature" of a player better.
4) I'm currently working on a much better (in theory) version of the algorithm. Stay tuned!
It is my hopes that these problems can be fixed by programmers out there. I am hoping that INTREPID is a good enough reason to motivate some coders.
|
|
|
|
|
haha nice! btw, what's the address of the website?;
|
oops, forgot to include address
|
This sounds really cool, nice job! 
|
United States10774 Posts
haha this is really cool. been playing around with it for a while now
|
Apparently my TvT hotkeys are closest to Advokate's . Although I doubt the thing's ability to predict it accurately.
|
Belgium6775 Posts
|
On July 07 2009 07:21 Sadistx wrote:
Apparently my TvT hotkeys are closest to Advokate's . Although I doubt the thing's ability to predict it accurately.
You're lucky, my hotkeys/spam were just a mixture of like every z player in the database :[
|
On July 07 2009 07:26 littlechava wrote:Show nested quote +On July 07 2009 07:21 Sadistx wrote:
Apparently my TvT hotkeys are closest to Advokate's . Although I doubt the thing's ability to predict it accurately. You're lucky, my hotkeys/spam were just a mixture of like every z player in the database :[
HA HA I EVEN FOUND MYSELF IN THE DATABASE, AWESOME TOOL
|
hmm it looks like my hotkeys/spam are pretty generic. Interesting tool, I hope you can improve it for greater accuracy, although I don't think romad is replaceable in terms of accuracy.
|
sweeeeet, would you like people to share replays with you? I have 7600 replays of koreans and im sure romad has a crapload more.
|
Hmm.. rekrul is apparently Lzgamer. Hehe. Regardless, good work, Stryker!
|
Cool, I found myself easily in both ZvP and PvZ so I guess that means I have a unique signature? :D
For ZvT I found myself at the top, but lots of others in between further down.
Yeah this seems cool.
|
is awesome32278 Posts
|
infinity21
Canada6683 Posts
apparently my replays are closest to merz's but even that's 3.5~5 so not that close >_>
|
MIT ALUMNI USA MATH OLYMPIAD KOREAN STARCRAFTERS FTW
|
Amazing idea. I can not imagine how long this took.
|
Awesome system.
I score about a 1-1.5 in every aspect with David, and I don't even know who that is. >.>
|
On July 07 2009 08:39 jimminy_kriket wrote:
sweeeeet, would you like people to share replays with you? I have 7600 replays of koreans and im sure romad has a crapload more.
Yes, that would be amazingggggggggggg. PM me asap :D
|
On July 07 2009 09:36 Monkeyz_Rule wrote:
Awesome system.
I score about a 1-1.5 in every aspect with David, and I don't even know who that is. >.>
OH man your hotkeys are the same as biblical legend David!
How does it feel to be legendary?
I bet you could slay like 3 goliaths... maybe even a whole control group.
(hopes people get it..and appreciate people who try way too hard with their puns...)
|
infinity21
Canada6683 Posts
btw, I forgot to mention that this is pretty fucking awesome
|
this is great.
wow, your a genius.
|
tested it.
i'm something in between mondragon, castro and dashwriter.
could use some work on display of results, at least the legend.
|
wow, great work ! deserves more than just a blogpost imo ^^
|
Apparently, I'm closest to ret (HELL YEAH!) and notforu.
|
wow this is amazing stuff
apparently i hotkey stuff like mistrzz, and do everything else like tsl-valentine.
overall i'm not even <1.5 to anyone though 
|
anti smurf
|
Doubt I'll ever use it but good work dude.
|
Great great idea man
|
looks very interesting! good job :O
|
Kau
Canada3500 Posts
Hmm bug?
Fatal error: Call to undefined function php_bw_load_replay() in /home4/hyunsook/public_html/starcraft/intrepid/tools/skim_replay.php on line 70
My ZvT is the Room Temperature of yours stryker.
|
On July 07 2009 14:51 Kau wrote:
Hmm bug?
Fatal error: Call to undefined function php_bw_load_replay() in /home4/hyunsook/public_html/starcraft/intrepid/tools/skim_replay.php on line 70
My ZvT is the Room Temperature of yours stryker.
i get this error every time too
|
The file 'Draco_Horror_1.rep' has been successfully uploaded.
Fatal error: Call to undefined function php_bw_load_replay() in /home4/hyunsook/public_html/starcraft/intrepid/tools/skim_replay.php on line 70
|
Duno why the path to the repasm.so file was broken, but it should work now!
|
So I took a look at my LastReplay.rep twice, the first being five hours ago. Since then my apm has increased by 10.
However, my TvP Building Hotkeys and Hotkey Assignments still have a 0 when compared to Cronus Wing, Epsilon Squadron, and Elite Guard. I'm a computer =[
|
On July 07 2009 09:50 TheFoReveRwaR wrote:Show nested quote +On July 07 2009 09:36 Monkeyz_Rule wrote:
Awesome system.
I score about a 1-1.5 in every aspect with David, and I don't even know who that is. >.> OH man your hotkeys are the same as biblical legend David! How does it feel to be legendary? I bet you could slay like 3 goliaths... maybe even a whole control group. (hopes people get it..and appreciate people who try way too hard with their puns...)
i lold
|
i thought my hotkeys were pretty generic
what makes the signature unique?
|
This is neat. I'm going to have to play with it
|
On July 08 2009 00:06 IdrA wrote:
i thought my hotkeys were pretty generic
what makes the signature unique?
I will use this replay as a test replay: http://files.getdropbox.com/u/4422/TL blog/intrepid/IdrA_vs_Dream.t)Zizi_2.rep
By uploading it to INTREPID, I can tell you how your signature in this replay compares to the ones in the database.
One thing you have to remember is that my database does not contain all the replays in the world, so your uniqueness may be only within the database, which is mostly full of foreigner replays. Still, I do have some progamer replays.
Interesting observation: you'll never be confused with advokate. His keys practically miss all of your keys with a total score of over 20.
It seems like your signature is unique in all aspects -- building hotkeys, hotkey actions (whether you 1a2a, 4a5a, 1o2o, 5o, etc.), hotkey spam (1232323), and hotkey assignments. Your signature dominates the top 20 in each category (except possibly hotkey spam). You can see for yourself by uploading the rep.
The building hotkeys and hotkey assignments take into account when and how often you assign each key relative to other keys. You might assign Command Center to 1, 2, 3 just like everyone else, but you might press 1, 2, 3 in the ratio 10%, 10%, and 80% or something or assign them at a unique time. Your spam may be 123 like everyone else, but maybe the sequence 23 occurs more often than 13. The program takes into account not just the fact that you use 123 for spam, but how often you use certain sequences of hotkeys, such as 23 vs 13 vs 21. Your hotkey spam is pretty similar to BRAT_OK's though. You and BRAT_OK dominate the hotkey spam.
Also, your hotkey assignments and spam are very consistent, which also helps here because then the top results are not sporadically filled with other players. In hotkey spam section, the top 6 are you and they're all 0.00xx, which is a very, very small score. I've noticed that TT1 also has a very unique and consistent spam signature.
I must add, the consistency probably also stems from the fact that you don't cheese much, lol. Different build orders often yield different spam and assignment keys. These results may indicate that you play the same way every game, down to the hotkey spam and all.
|
wow. this program is awesome. I already used it to identify a Iccup-Smurf i wanted to know.
|
On July 08 2009 01:47 Keniji wrote:
wow. this program is awesome. I already used it to identify a Iccup-Smurf i wanted to know.
o_O would you mind telling me? (pm if needed)
|
It's not picking me up ! I don't even get results... I doubt anyone has the same hotkeys/spam as I do...
Edit: Okay finally results pop up.. (took like 5 minutes)
2.5 on If.anmabang? cool
|
|
|
My host is going through some Apache upgrades or something. Pretty annoying! Let's hope it comes back up.
I just received a few thousand progamer replays, so I'm excited to see how much value it can add to INTREPID!
|
Can you give any interesting examples of INTREPID revealing a smurf to be someone well-known?
|
On July 15 2009 06:41 lac29 wrote:
Can you give any interesting examples of INTREPID revealing a smurf to be someone well-known?
If you look above, Keniji says he was able to identify someone. I pm'ed him but got no response. If I get positive responses, I'll definitely compile them and blog about them!
|
At first I thought this was a joke... then I realized he was serious...
|
The file 'LastReplay.rep' has been successfully uploaded.
Fatal error: Call to undefined function php_bw_load_replay() in /home4/hyunsook/public_html/starcraft/intrepid/tools/skim_replay.php on line 70
:[
|
On July 08 2009 00:06 IdrA wrote:
i thought my hotkeys were pretty generic
what makes the signature unique?
i think you're the only one i've seen who at the start goes control123control123control
Is there anyone else who does that?
In bwchart most people theres this streak where they spam their cc hotkey but for your reps theres this gap at the start.
Your structure though is the most common structure that i see.
1 cc 2 scout 3456 fact etc.
The thing i did noticed which changed in your reps is that in the tsl reps you didnt use 6 to center on your raxes.
he file '0505 GGZTPZ nyx)..machinaT.rep' has been successfully uploaded.
Fatal error: Call to undefined function php_bw_load_replay() in /home4/hyunsook/public_html/starcraft/intrepid/tools/skim_replay.php on line 70
oh boo
|
keeps giving me that fatal error shit
|
finally got it working and im very close to building hotkeys with artosis, actions with Advokate spam with lastshadow and asignment with sumadream
woot
|
|
|
|
|
|
|
|
EPT![[image loading]](http://files.getdropbox.com/u/4422/TL%20blog/intrepid/first_page.JPG)
![[image loading]](http://files.getdropbox.com/u/4422/TL%20blog/intrepid/second_page.JPG)
