• Log InLog In
  • Register
Liquid`
TeamLiquid Liquipedia LiquidDota LiquidLegends
EDT 18:08
CEST 00:08
KST 07:08
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[BSL15] Ro16 Recap Pt.13Lore of the Nexus: The Angiris Council0DHM Valencia: Power Rank52[TSL9] Prize Pool & Talent18Code S RO10 - Group B, Day 1 Preview (Season 2)7
Community News
2022 AfreecaTV Challengers Starleague Season 211BSL 2v2 ProLeague x ShieldBattery - SIGN UP NOW!14Code S RO10 Groups announced, RO20 final results1ESL Open #128: ByuN, MaxPax, Scarlett win3Artosis to leave Korea after GSL Season 3, possibility of online GSL casts?87
StarCraft 2
General
Rogue & Trap out for DHM Valencia? Doublelift on State of SC2 and the Various Regions Zest Retires Forbidden Ground buildings DHM Valencia: Power Rank
Tourneys
DreamHack Masters: Valencia 2022 - Main Event [TSL 9] Qualifiers HSC XXI Qualifiers [GSL 2022] Code S:Season 2 - Ro10 Group A ProBots 2022 Season 2
Strategy
herO's PvZ Simple Questions Simple Answers What should I try to work on to improve my TvZ [G] YAKS LOTV: Yet Another hotKey Setup - zerg
Custom Maps
Simple Questions/Answers [A] SC Real Scale
External Content
Mutation # 324 Violent Night Mutation # 323 Well Trained Mutation # 322 Warp Zone Mutation # 321 Rise From Ashes
Brood War
General
BW General Discussion repmastered.app: replay sharing and analyzer site BGH auto balance -> http://bghmmr.eu/ [BSL15] Ro16 Recap Pt.1 YellOw wins poker tournament for $696,000 USD
Tourneys
Hawk vs Artosis Show match July 6th 50$ prize pool No-Worries League - Similar-Skill Match-Making Deathfate Pro Team League 2 Announcement [BSL15] - RO16 Group C - Friday 17:00 CEST
Strategy
A new RTS map for scbw Project: Strat Update ZvT Guardian Hydra Optimized Strategy before the gosus
Other Games
General Games
Path of Exile Final Fantasy XIV Diablo Immoral The PlayStation 5 Crossfire: Legion - A new RTS combining C&C and SC
Dota 2
[DPC 21-22] Tour 3 Discussion/LR Official Dota and Chess General Discussion TL.net migration megathread + LiquidDota archive LiquidDota to reintegrate into TL.net LiquidDota Site Rules
League of Legends
[Patch 12.7] Arcana Skins Release Discussion LiquidLegends to reintegrate into TL.net [Summer Split] LoL Esports General Discussion [Patch Notes] Release General Discussion
Heroes of the Storm
HotS: WP and Funny Moments Lore of the Nexus: The Angiris Council Mapping Heroes: Battleground Stats
Hearthstone
TL Mafia
British Empire Mini Mafia II TL Mafia Community Thread Chezinu streak(s) Mafia Sengoku Mafia Survivor II: The Amazon
Community
General
Russo-Ukrainian War Thread US Politics Mega-thread NASA and the Private Sector If you're seeing this topic then another mass shooting happened and people disagree on what to do The Games Industry And ATVI
Fan Clubs
Day[9] Fan Club soO Fan Club Zest Fan Club
Media & Entertainment
Anime Discussion Thread Korean Music Discussion Movie Discussion! [TV] HBO Game of Thrones [Manga] One Piece
Sports
2021 - 2022 Football Thread Formula 1 Discussion NBA General Discussion 2021 NFL/CFB Season McBoner: A hockey love story
Tech Support
Computer Build, Upgrade & Buying Resource Thread Starcraft 2 No longer going on top of Start Bar The Ultimate Mouse Thread
TL Community
The Automated Ban List
Blogs
Helping
ChristianS
On Radicalization and S…
plasmidghost
Bravery and cowardice…
Starlightsun
My daughter wants to pla…
JoinTheRain
On gun violence in America…
MrBitter
First time having "S*X".
Garnet
Gomorrah
Broodwar4lyf
Getting Back to it..!.20 years…
FuDDx
Customize Sidebar...

Website Feedback

Closed Threads



Active: 1196 users

[mod] ELO rating for SC2

Forum Index > SC2 Maps & Custom Games
Post a Reply
turtles
Profile Blog Joined August 2011
Australia360 Posts
Last Edited: 2012-07-24 18:47:15
July 24 2012 07:44 GMT
#1
[image loading]

I'm just in the last stages of creating a mod which can be added to any map and will keep track of the players Elo rating.

For those of you who do not know what an Elo rating is it is the ratings system used in chess and many other competitions (including League of Legends).

This is so that people in clans who practice against eachother in custom games already can have a rating to compare each other with. Simply looking at things like ladder ranking will not be an effective way to compare players. This mod was origionally a request by one of the best clans from SEA but I decided to make it more general purpose so it could be used by many different clans/communities. In fact, many people have been requesting that Blizzards public ladder be an Elo system from the very release of SC2.

How it works is:
# join the game with your opponent.
# you can create a new tournament and provide a password if you wish it to be private
# select which tournaments you would like to be rated in.
# click on "compete" to activate a tournament or "opt out" to deactivate it
# When either player clicks on "ready" the game will begin.
# each players score will be recorded based on win/loss and updated for the next game.

Once it has been set up how you like it the first game simply click on the "ready" button each time you play and you don't even have to think about it other than that. It will just keep tracking your Elo rating across all games and all maps with this mod in it providing a usefull and meaningful comparisson of players in your clan/friends group/community.

I have included some pics to demonstrate the creation/selection of tournaments

at the start of the game:
+ Show Spoiler +
[image loading]


One player inviting the other to a tournament
+ Show Spoiler +
[image loading]


Players click on "compete" to enter the tournament
+ Show Spoiler +
[image loading]


Demonstration of me trying to cheat by editing my bank file to artificially increase my rating in "Global" (notice that it has been erased from my profile) and providing a false password to try and join the "Evil Geniuses" group.
+ Show Spoiler +
[image loading]


Notice that in the "active tournament" list each tournament has the percentage chance for each player to win calculated by their ratings.

NOTE: To demonstrate I just picked some well known names randomly from the EG/TL clans. I don't mean to imply anything about their relative skill levels.

Currently this will not work on screen resolutions < 1280x720. That will be one of the first things I will be fixing.

I am currently looking for people to help test the mod or to just provide general feedback. at the moment there is only 1 map released with this mod which is "ELO Cloud Kingdom". Just search for Elo on NA server and it should be listed. Thanks and I look forward to hearing what you all think.

Thanks for your time.
Turtles.

Elo details:
+ Show Spoiler +
In the near future more customization will be possible but for the moment players start with a rating of 1000. K is set at 15 and there is a minimum limit set on ratings to prevent deflation. I will soon be putting in measures to stop inflation as well as maybe giving the computer AI a fixed Elo rating for each difficulty level to help stabalize scores.


Anti-cheating measures:
+ Show Spoiler +
"a chain is only as strong as it's weakest link". Currently all maps can be cracked and any methods to secure data in a bank file reverse engineered (there is nothing anyone but Blizzard can do about this). Players Elo scores are protected with a one way hash function such that some joe-schmoe can't simply just go and edit them directly. However, I have no doubt that some bright cookie with WWAAAAYYYY too much time on his hands would be able to cheat and give himself a higher rating
+ Show Spoiler +
[F_]aths
Profile Blog Joined February 2010
Germany3947 Posts
Last Edited: 2012-07-24 13:55:44
July 24 2012 13:14 GMT
#2
The UI looks good.

Is Elo the best rating system for a game like Starcraft? Systems like TrueSkill or Glicko are maybe better. The main difference is that they use more than one value, so one can also see the estimated confidence (accuracy) in the rating.

(By the way it is Elo, not ELO.)
You don't choose to play zerg. The zerg choose you.
TaShadan
Profile Joined February 2010
Germany1955 Posts
July 24 2012 17:00 GMT
#3
ELO is atleast better than the actual system. Glicko is ELO with deviation?
Total Annihilation Zero http://www.moddb.com/mods/total-annihilation-zero
turtles
Profile Blog Joined August 2011
Australia360 Posts
July 24 2012 18:45 GMT
#4
Is Elo the best rating system for a game like Starcraft? Systems like TrueSkill or Glicko are maybe better.


I'm glad you asked

I will be putting a check box in the "create new tournament" dialog so you can chose Elo or Glicko (maybe other systems such as TrueSkill). I have had this intention from the begining so it will not be hard to do.

The hard bit is getting the dialogs set up so that the two players can interact with the lists of tournaments simultaniously which I think I have mostly bugless by now (or at least only small squishy bugs).

Elo is the most widely known algorithm and what was origionally requested so thats how I started it.

Glicko is ELO with deviation?

In a nut shell, yes.

By the way it is Elo, not ELO.

Thanks. Fixed.
[F_]aths
Profile Blog Joined February 2010
Germany3947 Posts
Last Edited: 2012-07-25 11:22:24
July 25 2012 09:50 GMT
#5
About the Elo name: The system was devised by Arpad Elo, "Elo" is no acronym.

I don't know about the details of how you store the points. Maybe a solution could be, to – unless one opts out – calculate the points for any system which is implemented.

I am no rating system expert, so the following should be taken with that in mind. If we want to have a meaning full skill value instead of just a number which somehow is intended to reflect the skill, we should keep in mind that a win or loss streak maybe doesn't mean that much in Starcraft, but most rating systems react quite sensible.

The test of the rating accuracy could be to convert ranking difference in winning probability and check how good the prediction is. To lower the noise factor of course a good number of games has to be considered.

But unless a ranking system (be it Elo or Glicko) does allow predictions, I think the rating would be just a mathimatical play with no application.
You don't choose to play zerg. The zerg choose you.
turtles
Profile Blog Joined August 2011
Australia360 Posts
July 25 2012 20:29 GMT
#6
These are all bridges to be crossed when I get to them :D

I want to make sure that the basic system works well before expanding on it and it still needs a little work.

I would like to eventually accumulate data on how accurate the predictions are. Without getting into the tricky details I can think of ways to do this while preventing duplicates of data. But it would be a tricky task.



Elo assumes that a players performance will be normally distributed which might not be the case for SC2. If I were to gues I would think player performance would have a gradual slope on the low side and a steep slope on the higher side. Meaning that a player will usually play within a certain level of ability. On a good day they can get a slight edge and perform a bit better than normal but if their play is off then they can play really poorly at a much lower level than their normal play.

If I accumulate data that shows a different pattern then the algorithm could be adjusted. However I think people trust systems like Elo and Glicko and would prefer it to some custom ranking scheme I created even if it was more accurate.
iGrok
Profile Blog Joined October 2010
United States5142 Posts
July 25 2012 20:34 GMT
#7
I fully back the Turtles system.

Honestly, the Turtles system would be the most hilarious system for tracking rank.

"Hey iNcontroL, what's your Turtles rank?"
"OMG, Fantasy just got more Turtles than Flash!"
"You can't really compare SC2 Turtles to BW Turtles, that just doesn't make sense."
MOTM | Stim.tv | TL Mafia | Fantasy Fighting! | SNSD
turtles
Profile Blog Joined August 2011
Australia360 Posts
July 26 2012 18:59 GMT
#8
Obviously the turtles rank would be percentage of how good you are compared to others ranging from 0% to 99.9% which would be the highest available score.

I would just set it so that I was the only person in the world who was 100% turtles

+ Show Spoiler +

j/k

Pretty sure existing ranking systems are plenty "good enough" for the task. They also have the advantage that a lot of people already know how they work and have been shown to be useful in other fields
stormchaser
Profile Joined January 2011
Canada1009 Posts
July 26 2012 19:54 GMT
#9
Hm I'm intrigued, gonna try this out tonight.
VediVeci
Profile Joined October 2011
United States82 Posts
August 23 2012 00:47 GMT
#10
I'm not 100% comfortable with the higher level theoretical implications of trueskill, but one thing about trueskill is that it was created to deal with games involving multiple teams, each team with one or more players. That is where the main advantage of Trueskill lies for Microsoft, and trueskill isn't necessarily all that much better for head-to-head, 1v1 games. Further, since you don't have a matchmaking system implemented, the trueskill algorithm would be dealing with much larger discrepancies in skill and uncertainty than it is intended to, which I think may cause some wacky results (I'd have to double check this, I haven't looked over the math behind it in a few months).
Please log in or register to reply.
Live Events Refresh
Next event in 52m
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
Nathanias 591
UpATree 157
Forgg! 15
StarCraft: Brood War
Shuttle 1690
Jaeyun 142
Terrorterran 14
yabsab 12
IntoTheRainbow 9
Dota 2
qojqva6749
Dendi4158
canceldota357
Counter-Strike: Global Offensive
fl0m2289
Super Smash Bros
hungrybox1530
Heroes of the Storm
Liquid`Hasu732
Other Games
Grubby2735
shahzam1582
byalli458
JimRising 435
febbydoto27
ROOTCatZ2
Organizations
Other Games
gamesdonequick5197
Counter-Strike: Global Offensive
ESL CS:GO459
Dota 2
BeyondTheSummit327
StarCraft 2
OGamingTV SC2 149
Other Games
BasetradeTV54
StarCraft 2
Blizzard YouTube
[ Show 21 non-featured ]
StarCraft 2
• SteadfastSC379
• musti20045 31
• Adnapsc2 18
• Gussbus
• Migwel
• Alpha X_
• aXEnki
• Poblha
• intothetv
• CSOeSports
• Kozan
• IndyKCrew
• LaughNgamez Trovo
• Laughngamez YouTube
StarCraft: Brood War
• sscaitournament3
• STPLYoutube
• AfreecaTV YouTube
• BSLYoutube
League of Legends
• Froggen1614
Other Games
• imaqtpie2285
• Shiphtur1299
Upcoming Events
ESL Pro Tour
52m
KCM Race Survival
11h 52m
DPC 2021/2022 Tour 3
20h 52m
Evil Geniuses vs TBD
OSC
21h 52m
TeamLiquid StarLeague
1d 12h
TeamLiquid StarLeague
2 days
TeamLiquid StarLeague
3 days
TeamLiquid StarLeague
4 days
TeamLiquid StarLeague
4 days
TeamLiquid StarLeague
4 days
[ Show More ]
ESL Pro Tour
5 days
TeamLiquid StarLeague
5 days
TeamLiquid StarLeague
5 days
TeamLiquid StarLeague
5 days
ESL Pro Tour
6 days
Liquipedia Results

Completed

2022 ACS Season 2: Qualifier
DH Masters Valencia
X-Cup Summer 2022 - Qual. 5
ESL Challenger Valencia 2022

Ongoing

BSL Season 15: GosuLeague
Luck Over Strength
STL37
RCG 2021
KCM Ladies Race Survival 2022 Season 2
Nine-Tathlon Invitational
HoneyCai Friendlies Season 4
GAN Race Survival Season 4
CWCL Season 4
FS Mania
Big Baby Popularity Contest
KCM Race Survival 2022 Season 2
BSL Season 15
Deathfate Pro Team League
TOP Challenge Qualifier
WTL 2022 Summer
2022 GSL S2: Code S
StarCraft II: NationWars 7
Community Clash League S4
X-Cup Summer 2022 - Quals.
Masters Clash Champ. 2022

Upcoming

Deathfate Pro Team League 2: Qualifier
Future Cup 4 (U18)
NiuPi Cup CN vs KR 1: Mihu vs Mighty
TOP Challenge
2022 ACS Season 2
NiuPi Cup 7: Soma vs sOrry
WSL Season 3
IEM Katowice 2023
2022 GSL: ST 2
DH Masters Atlanta
2022 GSL S3: Code S
TSL 9
HomeStory Cup XXI
X-Cup Summer 2022
X-Cup Summer 2022 - Qual. 10
X-Cup Summer 2022 - Qual. 9
X-Cup Summer 2022 - Qual. 8
X-Cup Summer 2022 - Qual. 7
X-Cup Summer 2022 - Qual. 6
IEM Rio Major 2022
ESL Challenger Melbourne 2022
ESL Pro League Season 16
BLAST Premier Fall Groups
ESL Challenger League S42 NA
ESL Challenger League S42 EU
ESL Challenger League S42 AP
IEM Cologne 2022
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2022 TLnet. All Rights Reserved.