• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 21:45
CEST 03:45
KST 10:45
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[ASL22] Ro8 Preview: Within Reach5[ASL22] Ro8 Preview: In A Tizzy11[ASL22] Ro16 Preview: Holy Diver5[ASL22] Ro16 Preview: Rough Waters10[ASL22] Ro24 Preview: Siren's Call8
Community News
StarCraft II 5.0.17 PTR Patch Notes (Sept 30, 2026)54Weekly Cups (Sept 21-27): herO and ByuN double2Weekly Cups (Sep 13-20): herO scores triple3BSL Season 2313Weekly Cups (Sep 7-12): SHIN, ByuN, MaxPax double down1
StarCraft 2
General
StarCraft II 5.0.17 PTR Patch Notes (Sept 30, 2026) How do you feel about the mass reverts in the 5.0.17 PTR? SC4ALL: II SC2 Complete Invited Player Lineup StarCraft open world shooter announced at BlizzCon Weekly Cups (Sept 21-27): herO and ByuN double
Tourneys
Sea Duckling Open (Global, Bronze-Diamond) Stellar Fest TWO the Moon (Dec 16-20) 2026 GSTL Grand Finals SC2 INu's Battles#21 [ 3-Days tournament ] ScienceCraft (October 24-25) - Live Event
Strategy
[H] ZvP Mid-Late Game: Stalkers Collossi HT
Custom Maps
[M] (2) Sweltering Sands [M] (2) Frigid Storage
External Content
The PondCast: SC2 News & Results Mutation # 545 And Drops and Rifts Mutation # 544 Double Trouble Mutation # 543 Enhanced Defenses
Brood War
General
Bot on ladder Fantasy returning? BW General Discussion ASL22 General Discussion a Announcement on the JEDI Ringing
Tourneys
[ASL22] Ro8 Day 4 [Megathread] Daily Proleagues [ASL22] Ro8 Day 3 [ASL22] Ro8 Day 2
Strategy
Cliff Jump Revisited (1 in a 1000 strategy) Replay Review Process - What do you do? Simple Questions, Simple Answers Odyssey Mineral Stack Saturation
Other Games
General Games
Nintendo Switch Thread General RTS Discussion Thread Warcraft III: The Frozen Throne Stormgate/Frost Giant Megathread Total Annihilation Zero
Dota 2
Dota 2 Champions League Season 3 Begins April 25! Official 'what is Dota anymore' discussion
League of Legends
[TL LoL EUW IHs] Teemo shall perish
Heroes of the Storm
Heroes of the Storm 2.0
Hearthstone
Deck construction bug
TL Mafia
TL Mafia Community Thread
Community
General
Things Aren’t Peaceful in Palestine US Politics Mega-thread Russo-Ukrainian War Thread Artificial Intelligence Thread All you football fans (soccer)!
Fan Clubs
Serral Fan Club
Media & Entertainment
Movie Discussion! [Manga] One Piece Diablo Animated Series on Netflix
Sports
Football (Soccer) Thread MLB/Baseball 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Recent Gifted Posts
Blogs
[ASL22] Ro4 Day1 Ticket Giv…
bITt.mAN
Escaping Into Video Games: G…
TrAiDoS
38 yo Retired SWE loo…
PurE)Rabbit-SF
Can Bots Beat Pros?? Starcr…
namkraft
[meme] I finally understa…
LUCKY_NOOB
Regacy Esports:Our Goa…
regacyesports
Customize Sidebar...

Website Feedback

Closed Threads



Active: 7279 users

Dota 2 Bot API: The (glut)Initial step

Blogs > LetaBot
Post a Reply
LetaBot
Profile Blog Joined June 2014
Netherlands557 Posts
February 09 2016 21:20 GMT
#1
Creating a Dota 2 Bot API Part 1: The (glut)Initial step
I decided to take a small break from creating my StarCraft bot (Wiki)LetaBot to see how well bots perform in other e-sport titles. While checking the subreddit, I found out that Dota 2 has an offline LAN mode. This got me interested in checking if it was possible to create a bot API for Dota 2 like the one that Matthew Fisher did for StarCraft 2 ( https://graphics.stanford.edu/~mdfisher/GameAIs.html ). The advantages for using this method over the build-in scripting language is that a build-in scripting language is significantly slower than C++ code, and you cannot store/retrieve as much information as your hard drive can handle ( haven't used Dota 2 script, so correct me if I am wrong about Dota 2 script limitations).

The problem with using DirectX interception to create a bot for StarCraft 2 is that you have to use battle.net to play against other players, and Blizzard won't like it if you use DirectX interception on battle.net . After all, DirectX interception allows you to do stuff like this:

[image loading]

Or even more outlandish stuff like this.

But with an offline LAN mode, you don't have to worry about this sort of stuff getting you banned and leaving you with no other options to play versus other players.

The first attempt to get the graphics interceptor was to use the Matthew Fisher's DirectX interceptor on Dota 2, since the interception part of the code doesn't care about the program it is used on ( placing the modified d3d9.dll in the dota2.exe folder makes it load that one instead of the one in system32 ). This doesn't seem to work since dota 2 crashes when it tries to start up the main menu ( probably something involving the shaders that dota 2 uses, as you will see in apitrace below. ). It did manage to store the load screen textures:

[image loading]

So when I contacted Matthew Fisher, he directed me to a different program called apitrace. That one does manage to collect all the directX API calls, but for some reason it has problems with the shaders as well, causing the frame replay to look mostly black ( with only the top/bottom GUI, healthbars and some flame effects visible). So instead I switched to OpenGL. One driver update later I was capable of getting apitrace to record and replay the OpenGL calls.


Some pictures of the success below:


[image loading]

This is the texture of (Wiki)tiny IIRC.

[image loading]

Scene rendering in progress. Notice the checkerboard textures below each hero (and the spells), and the fact that this image is flipped ( vertically, the original image was upside down ).



Since apitrace is open source, this can be use as an initial starting point to use the same technique that Matthew Fisher used to make his StarCraft 2 bot.
Very ( very very ) simply put, the following needs to be added to the apitrace to make it usable for a Dota 2 Bot API:

- Know which texture belongs to which hero. You can look at Matthew Fisher's texture table for StarCraft 2 to see an example of this.

- Know when these textures are drawn, and where on the screen the texture/hero is located ( as in, not on the XY coordinates of the dota 2 map, but the XY coordinates of your monitor ).

- Use the information above to determine when/where to click on the screen. You are basically sending click commands instead of using a physical mouse, just like AutoIt and other related programs do. The difference is that you aren't relying on the color of certain pixels like a simple runescape bot, but on the information that is send through the graphics pipeline (getting this information purely based on the pixels on the screen is too complex for a game like Dota 2: it would take too much time to process and dota 2 is too fast paced for that).


Besides hero location you ofc also need things like the location of creeps, your/ally/enemy health and all that sort of stuff.


Anyway, I am going back to my StarCraft bot now. I still have to wrap up my master thesis on it. If anyone is interested in already starting on developing such an API, you can pm me and I can give you some (OpenGL, graphic pipeline) guides that can help you get started. In general you will need to know about C++ and OpenGL ( general 3d graphics knowledge should suffice as well, it is mainly about extracting information, not programming OpenGL ). I myself will start digging more into this stuff next month (March).
If you cannot win with 100 apm, win with 100 cpm.
Birdie
Profile Blog Joined August 2007
New Zealand4438 Posts
February 09 2016 22:38 GMT
#2
Are you not able to just memory scan for on-screen hero locations and minimap hero locations? Surely this would be far easier than graphics hooks.
Red classic | A butterfly dreamed he was Zhuangzi | 4.5k, heading to 5k as support!
Sn0_Man
Profile Blog Joined October 2012
Tebellong44238 Posts
February 09 2016 22:41 GMT
#3
Interesting

Just out of curiosity, are you aware that valve wrote some of their own bots?

Which of course are quite different since they don't seek to simulate human interaction with the client in any way of course, but still something worth thinking about.
LiquidDota StaffSCIENTISTS BAFFLED | 3275929302
LetaBot
Profile Blog Joined June 2014
Netherlands557 Posts
Last Edited: 2016-02-09 23:19:33
February 09 2016 23:18 GMT
#4
On February 10 2016 07:38 Birdie wrote:
Are you not able to just memory scan for on-screen hero locations and minimap hero locations? Surely this would be far easier than graphics hooks.


That is what the BWAPI does for StarCraft Brood War. However, one update could change all the relevant opcodes, which means that you have to redo the process. Whereas the textures tend to stay the same for each hero after an update. And even if it changes it is just a matter of finding the right texture again instead of having to go trough the entire program looking for the memory adress.

On February 10 2016 07:41 Sn0_Man wrote:
Interesting

Just out of curiosity, are you aware that valve wrote some of their own bots?

Which of course are quite different since they don't seek to simulate human interaction with the client in any way of course, but still something worth thinking about.


Yes, I know about the build-in bots. But those are very easy to defeat. I don't recall them releasing an API to control these bots directly.
If you cannot win with 100 apm, win with 100 cpm.
Ler
Profile Blog Joined August 2012
Germany543 Posts
February 10 2016 08:13 GMT
#5
I am also kinda in bot programming and I was kinda impressed when I read about the Sc2 bot Matthews released. If you continue your work, write about it please
Twitter: @Ler_GG | Facebook: lergg | youtube: lerlolgg | Twitch.tv/gg_nore | #ArtOfSupport
misirlou
Profile Joined June 2010
Portugal3316 Posts
February 10 2016 12:31 GMT
#6
Is it not possible to code bots on dota 2 tools for custom maps?
evanthebouncy!
Profile Blog Joined June 2006
United States12815 Posts
February 10 2016 12:46 GMT
#7
well lemme know once you finished writing an api wrapper

is there a way to canonicalize hero appearance? I imagine it'll be much easier if all the hero appeared the same and not altered by the costumes they wear.
Life is run, it is dance, it is fast, passionate and BAM!, you dance and sing and booze while you can for now is the time and time is mine. Smile and laugh when still can for now is the time and soon you die!
LetaBot
Profile Blog Joined June 2014
Netherlands557 Posts
February 10 2016 13:46 GMT
#8
On February 10 2016 21:31 misirlou wrote:
Is it not possible to code bots on dota 2 tools for custom maps?



It is. But as I mentioned, the scripting language is a lot slower compared to native C++ code. Also you can store/retrieve more data between matches using file I/O . I don't even know if file input/output is possible with the scripting language.

Since dota 2 is quite complex, I don't think that simple scripts are going to be enough to create bots that can defeat top level human players.
If you cannot win with 100 apm, win with 100 cpm.
spamduck101
Profile Joined August 2015
United States8 Posts
February 10 2016 16:19 GMT
#9
Very cool! Keep us posted. I didn't know about Matt's SC2 stuff. That was a fun read.
misirlou
Profile Joined June 2010
Portugal3316 Posts
February 10 2016 20:27 GMT
#10
On February 10 2016 22:46 LetaBot wrote:
Show nested quote +
On February 10 2016 21:31 misirlou wrote:
Is it not possible to code bots on dota 2 tools for custom maps?



It is. But as I mentioned, the scripting language is a lot slower compared to native C++ code. Also you can store/retrieve more data between matches using file I/O . I don't even know if file input/output is possible with the scripting language.

Since dota 2 is quite complex, I don't think that simple scripts are going to be enough to create bots that can defeat top level human players.

I didn't think that was what you meant by "built in scripting language" but it makes sense now. Yeah I guess the scripts are limited that way and I don't see valve adding file I/O support for it since you could basically start distributing a bunch of crap that would harm a system via the workshop.
evanthebouncy!
Profile Blog Joined June 2006
United States12815 Posts
February 11 2016 13:47 GMT
#11
On February 10 2016 22:46 LetaBot wrote:
Show nested quote +
On February 10 2016 21:31 misirlou wrote:
Is it not possible to code bots on dota 2 tools for custom maps?



It is. But as I mentioned, the scripting language is a lot slower compared to native C++ code. Also you can store/retrieve more data between matches using file I/O . I don't even know if file input/output is possible with the scripting language.

Since dota 2 is quite complex, I don't think that simple scripts are going to be enough to create bots that can defeat top level human players.


do we know if the scripting language is turing complete or is it actually very primitive like that of starcraft map editor?
Life is run, it is dance, it is fast, passionate and BAM!, you dance and sing and booze while you can for now is the time and time is mine. Smile and laugh when still can for now is the time and soon you die!
Torte de Lini
Profile Blog Joined September 2010
Germany38463 Posts
January 06 2017 21:45 GMT
#12
Bumping this. Is Letabot still around?
https://twitter.com/#!/TorteDeLini (@TorteDeLini)
Please log in or register to reply.
Live Events Refresh
OSC
00:00
OSC Elite Rising Star #21
CranKy Ducklings81
Liquipedia
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
NeuroSwarm 142
RuFF_SC2 125
ProTech102
StarCraft: Brood War
Britney 15390
Rain 2232
Artosis 589
NaDa 19
Bale 15
League of Legends
Doublelift4514
Counter-Strike
taco 349
Super Smash Bros
hungrybox759
Mew2King153
Heroes of the Storm
Khaldor970
Other Games
summit1g8594
Day[9].tv671
JimRising 586
PiGStarcraft302
C9.Mang0275
ArmadaUGS66
ViBE58
Organizations
Other Games
BasetradeTV287
Dota 2
PGL Dota 2 - Main Stream89
[ Show 14 non-featured ]
StarCraft 2
• Hupsaiya 139
• CranKy Ducklings SOOP66
• Letter143
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Other Games
• Day9tv671
• Scarra596
• Shiphtur210
Upcoming Events
Stellar Fest
11h 15m
OSC
20h 15m
CranKy Ducklings
1d 8h
Online Event
1d 9h
FEL
1d 14h
AI Arena Tournament
1d 15h
BSL: Ladder Tournament
1d 17h
Sparkling Tuna Cup
2 days
INu's Battles
2 days
herO vs Classic
Percival vs Rogue
BSL Open Qualifier
2 days
[ Show More ]
BSL Open Qualifier
2 days
Replay Cast
2 days
Afreeca Starleague
3 days
Rush vs Light
WardiTV Weekly
3 days
Replay Cast
3 days
Afreeca Starleague
4 days
Soma vs Soulkey
INu's Battles
4 days
SHIN vs Cure
ByuN vs Zoun
PiGosaur Cup
4 days
The PondCast
6 days
INu's Battles
6 days
Liquipedia Results

Completed

Proleague 2026-09-30
Blizzard Classic Cup 2026
Calamity Invitational

Ongoing

ASL Season 22
Super Anchor Qualifying S3
CSL 2026 AUTUMN (S22)
Acropolis #5
Stake Ranked Episode 4
1win Private Club #1
Logitech G Play Connect 2026
SL StarSeries Fall 2026
FISSURE Playground #3
BLAST Open Fall 2026
Esports World Cup 2026
BLAST Bounty Summer 2026
BLAST Bounty Summer Qual

Upcoming

Acropolis #5 - GSB
Acropolis #5 - GSC
BSL Season 23
SC4ALL II: Brood War
BSL 23: Non-Korean Championship
HSC XXX
Stellar Fest 2: Lunar Cup
SC4ALL II: StarCraft II
Kung Fu Cup 2026 Grand Finals
RSL Offline Finals
Custodian Cup
Copium Cup
PGL Major Singapore 2026
Stake Ranked Episode 6
BLAST Rivals Fall 2026
IEM Beijing 2026
Stake Ranked Episode 5
PGL Masters Bucharest 2026
1win Private Club #2
Thunderpick World Champ. '26
ESL Pro League Season 24
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.