• Log InLog In
  • Register
Liquid`
Team Liquid Liquipedia
EDT 19:16
CEST 01:16
KST 08:16
  • Home
  • Forum
  • Calendar
  • Streams
  • Liquipedia
  • Features
  • Store
  • EPT
  • TL+
  • StarCraft 2
  • Brood War
  • Smash
  • Heroes
  • Counter-Strike
  • Overwatch
  • Liquibet
  • Fantasy StarCraft
  • TLPD
  • StarCraft 2
  • Brood War
  • Blogs
Forum Sidebar
Events/Features
News
Featured News
[ASL22] Ro8 Preview: In A Tizzy2[ASL22] Ro16 Preview: Holy Diver5[ASL22] Ro16 Preview: Rough Waters10[ASL22] Ro24 Preview: Siren's Call8[ASL22] Ro24 Preview: Summer's End9
Community News
BSL Season 234Weekly Cups (Sep 7-12): SHIN, ByuN, MaxPax double down1StarCraft open world shooter announced at BlizzCon101Weekly Cups (Aug 30-Sep 7): herO thrives amid growing schism10Official StarCraft website teases new content ahead of BlizzCon?179
StarCraft 2
General
Balance hotfix patch 5.0.16b (July 16) StarCraft open world shooter announced at BlizzCon SC4ALL II: StarCraft 2 Player Announcement 8/8 The Death of Cheese: From a Professional Cheeser Yamato Cup Series
Tourneys
2026 GSTL Announcement Sparkling Tuna Cup - Weekly Open Tournament RSL Revival: Season 6 - Qualifiers and Main Event RSL goes to London! 2026 Offline Finals Nov 21-22 SC2 AI Tournament 2026 Fall
Strategy
[H] ZvP Mid-Late Game: Stalkers Collossi HT
Custom Maps
Nexus Wars 2021 GUIDE [M] (2) Industrial Park
External Content
Mutation # 544 Double Trouble The PondCast: SC2 News & Results Mutation # 543 Enhanced Defenses Mutation # 542 The Ascended
Brood War
General
BSL Season 23 Bot on ladder an AI researcher's take on the ladder bot BGH Auto Balance -> http://bghmmr.eu/ [ASL22] Ro8 Preview: In A Tizzy
Tourneys
[BSL23] SM: Ret vs TerrOr -> DragOn vs StRyKeR [Megathread] Daily Proleagues [ASL22] Ro16 Group D [ASL22] Ro16 Group B
Strategy
Cliff Jump Revisited (1 in a 1000 strategy) Replay Review Process - What do you do? Simple Questions, Simple Answers Odyssey Mineral Stack Saturation
Other Games
General Games
Nintendo Switch Thread Warcraft III: The Frozen Throne Stormgate/Frost Giant Megathread EVE Corporation Diablo IV
Dota 2
Dota 2 Champions League Season 3 Begins April 25! Official 'what is Dota anymore' discussion
League of Legends
[TL LoL EUW IHs] Teemo shall perish
Heroes of the Storm
Heroes of the Storm 2.0
Hearthstone
Deck construction bug
TL Mafia
TL Mafia Community Thread
Community
General
US Politics Mega-thread Things Aren’t Peaceful in Palestine All you football fans (soccer)! Russo-Ukrainian War Thread Canadian Politics Mega-thread
Fan Clubs
MarineLorD Fan Club The Creator Fan Club The ShoWTimE Fan Club
Media & Entertainment
Movie Discussion! [Manga] One Piece Diablo Animated Series on Netflix
Sports
Football (Soccer) Thread TeamLiquid Health and Fitness Initiative For 2023 MLB/Baseball 2023
World Cup 2022
Tech Support
Computer Build, Upgrade & Buying Resource Thread
TL Community
Recent Gifted Posts
Blogs
Gaming Intensity, Problemati…
TrAiDoS
38 yo Retired SWE loo…
PurE)Rabbit-SF
Can Bots Beat Pros?? Starcr…
namkraft
[meme] I finally understa…
LUCKY_NOOB
Regacy Esports:Our Goa…
regacyesports
Dreaming of BW patches (mod…
c3rberUs
Customize Sidebar...

Website Feedback

Closed Threads



Active: 9698 users

General Discussion - Page 3358

Forum Index > Dota 2 General
Post a Reply
Prev 1 3356 3357 3358 3359 3360 6534 Next
IRC chatter should remain in IRC - http://webchat.quakenet.org/?channels=tl.dota2

Posts that relate to topics with their own thread, such as in News, Tournaments or Strategy should go in those threads.
hfglgg
Profile Joined December 2012
Germany5372 Posts
July 19 2013 07:34 GMT
#67141
On July 19 2013 15:32 MVTaylor wrote:
Okay so I never played original dota and haven't played Dota2 much since the Abaddon patch.

Just got him in All Random.

How the fuck is that guy even remotely balanced? If you go full aura bitch on him you're providing arguably the best utility in the game to your team while being really fucking hard to kill, or at least to the extent that if they want to bring you down your team is going to clean them up while they do it.

I really cannot see him being added to CM for a long, long time. Other than the obvious "don't attack him when his ult is up" what are good counters?

I have like an 80% WR on my support / aura Omni but I'd just drop him in a second for Abaddon.


i have only seen him around 5 times in pubs now and my first impression of him is not so favourable. he just annoys the crap out of you because you cant lasthit that one creep, he denies himself with coiles and you have to wait 5 seconds to finish him off.
thats about it. maybe there are some strats that make him work, but abaddon is probably the least scarry hero in the pool bar treant right now. but treant is way more annoying.
ReignSupreme.
Profile Blog Joined September 2012
Australia4123 Posts
July 19 2013 07:35 GMT
#67142
Wheeeew that elo post was a good read, kudos

Now I have to resist the temptation to find all the people posting about how good this patch is because of how it changed the win-rate system in MM
Velr
Profile Blog Joined July 2008
Switzerland10953 Posts
July 19 2013 07:44 GMT
#67143
My games seem worse since patch...

In every game at least 3 guys pick "Mid"-Heroes and the one that actually goes because he's the most stubborn quickly proceeds to have 0 impact if not plain feed...
superstartran
Profile Joined March 2010
United States4013 Posts
Last Edited: 2013-07-19 07:46:06
July 19 2013 07:45 GMT
#67144
On July 19 2013 14:42 Kishin2 wrote:
Show nested quote +
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.
Kishin2
Profile Joined May 2011
United States7534 Posts
Last Edited: 2013-07-19 07:52:49
July 19 2013 07:52 GMT
#67145
On July 19 2013 16:45 superstartran wrote:
Show nested quote +
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.

Pretty sure Valve factor in things like gpm and k/d/a ratio to adjust ranking at this level. A newer player can get lucky and win but won't consistently goet 12/1/5 with 700-800 gpm and 900 xpm every game.
tapes
Profile Joined January 2013
487 Posts
July 19 2013 08:00 GMT
#67146
On July 19 2013 16:45 superstartran wrote:
Show nested quote +
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.


And what's the problem? If he plays well he clearly deserves to be at that skill level and if he feeds he most likely drops down quite a lot (unless he gets carried).
739
Profile Blog Joined May 2009
Bearded Elder29905 Posts
July 19 2013 08:01 GMT
#67147
On July 19 2013 16:52 Kishin2 wrote:
Show nested quote +
On July 19 2013 16:45 superstartran wrote:
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.

Pretty sure Valve factor in things like gpm and k/d/a ratio to adjust ranking at this level. A newer player can get lucky and win but won't consistently goet 12/1/5 with 700-800 gpm and 900 xpm every game.

Show me a newer player who can get 700-800gpm and 900 xpm in a game.
WriterSalty oldboy that loves memes | One and only back-to-back Liquibet Winner
Esoterikk
Profile Blog Joined May 2011
Canada1256 Posts
July 19 2013 08:13 GMT
#67148
On July 19 2013 17:00 tapes wrote:
Show nested quote +
On July 19 2013 16:45 superstartran wrote:
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.


And what's the problem? If he plays well he clearly deserves to be at that skill level and if he feeds he most likely drops down quite a lot (unless he gets carried).


It should require you to work your way up instead of rocketing you to the top and making you work your way down, that system helps no one.
Kishin2
Profile Joined May 2011
United States7534 Posts
July 19 2013 08:18 GMT
#67149
On July 19 2013 17:01 739 wrote:
Show nested quote +
On July 19 2013 16:52 Kishin2 wrote:
On July 19 2013 16:45 superstartran wrote:
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.

Pretty sure Valve factor in things like gpm and k/d/a ratio to adjust ranking at this level. A newer player can get lucky and win but won't consistently goet 12/1/5 with 700-800 gpm and 900 xpm every game.

Show me a newer player who can get 700-800gpm and 900 xpm in a game.

That's my smurf. My point was that accounts with low win numbers can get matched with high win number accounts and it doesn't mean the system is broken. That low win number player isn't that bad relative to players with high number of wins. LSB's link has a few reasons for why people may not think that is so, but is.
r.Evo
Profile Joined August 2006
Germany14081 Posts
July 19 2013 08:19 GMT
#67150
On July 19 2013 17:13 Esoterikk wrote:
Show nested quote +
On July 19 2013 17:00 tapes wrote:
On July 19 2013 16:45 superstartran wrote:
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.


And what's the problem? If he plays well he clearly deserves to be at that skill level and if he feeds he most likely drops down quite a lot (unless he gets carried).


It should require you to work your way up instead of rocketing you to the top and making you work your way down, that system helps no one.

It's a question of balance.

a) Someone who isn't actually good enough for it is playing at a MMR that's too high. Players in the high bracket get pissed about someone who seems too bad for them.

b) Someone is too good is playing at a MMR that's too low. Players in the low bracket get pissed about someone who is too good for them.


If Valve has to pick between those two I'm with them in believing that b) is the lesser evil. I'd rather get smurfs out of the way of newbs than newbs out of the way of legitimately good players.
"We don't make mistakes here, we call it happy little accidents." ~Bob Ross
Alur
Profile Blog Joined March 2008
Denmark3900 Posts
July 19 2013 08:28 GMT
#67151
On July 19 2013 17:19 r.Evo wrote:
Show nested quote +
On July 19 2013 17:13 Esoterikk wrote:
On July 19 2013 17:00 tapes wrote:
On July 19 2013 16:45 superstartran wrote:
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.


And what's the problem? If he plays well he clearly deserves to be at that skill level and if he feeds he most likely drops down quite a lot (unless he gets carried).


It should require you to work your way up instead of rocketing you to the top and making you work your way down, that system helps no one.

It's a question of balance.

a) Someone who isn't actually good enough for it is playing at a MMR that's too high. Players in the high bracket get pissed about someone who seems too bad for them.

b) Someone is too good is playing at a MMR that's too low. Players in the low bracket get pissed about someone who is too good for them.


If Valve has to pick between those two I'm with them in believing that b) is the lesser evil. I'd rather get smurfs out of the way of newbs than newbs out of the way of legitimately good players.

Sounds to me like you belive a) is the lesser evil.

AKA No can Dazzle | https://www.youtube.com/watch?v=PlTpX7z3Pok
TL+ Member
r.Evo
Profile Joined August 2006
Germany14081 Posts
Last Edited: 2013-07-19 08:48:11
July 19 2013 08:47 GMT
#67152
On July 19 2013 17:28 Alur wrote:
Show nested quote +
On July 19 2013 17:19 r.Evo wrote:
On July 19 2013 17:13 Esoterikk wrote:
On July 19 2013 17:00 tapes wrote:
On July 19 2013 16:45 superstartran wrote:
On July 19 2013 14:42 Kishin2 wrote:
On July 19 2013 14:22 LSB wrote:
Fletcher has been posting a bit about the dota ELO system. Although a lot of the information is pretty obvious I think it would be useful pasted somewhere for myself in case I lose the link
http://dev.dota2.com/search.php?do=finduser&userid=469173&contenttype=vBForum_Post&showposts=1

+ Show Spoiler +

>Match ID: 246510650

All 10 players in this game were in the 93rd-94th percentile MMR range. The difference in Elo's between the highest and lowest player was 50 Elo points. The "noob" with only 13 wins actually had the highest Elo of any player in the match. (This was a smurf.) They did play poorly in this match, but in the previous match (246456658), in which they played against several 4000 Elo players, they had 13 kills and 1 death.

>Match ID: 246567215

The 14-win player did have the highest MMR in the game. However, it probably wasn't really high enough to push him into smurf territory. So this was not a great match. There was a player who had waited 5 minutes, which is why a match of this relatively low quality was accepted. Thanks for reporting this. It's very helpful.

We're trying to find a way to provide more information about matchmaking, both how it works in general, and also why particular matches were formed. We're looking for a way to do this that does not lead to abusive behaviour now, where any lopsided game is immediately blamed on the person with the lowest win count, as opposed to, for example, somebody playing a hero they aren't familiar with or just having a bad game. This blame is often misplaced, but it's understandable since the win count is the only piece of data currently available.


>I still got 600 win vs 60 win players.

If you post a match ID, I might be able to help explain why it decided to form the match. Either it will help us improve the tuning, or there's probably some piece of data that makes it make sense that we are not exposing.

We are looking for a way to provide information to players to help them understand why matches were formed in a way that doesn't lead to abuse of whoever the "worst" player is (according to whatever metric is preferable to the person giving the abuse). In the meantime, walking through some particular matches will help us better understand where it's still getting things wrong, or educate players about how it's making its decisions.

Just to clarify, there was never any "win rate" calculation. Ever. It is true that a goal of matchmaking is to make even teams, so that the odds of the Radiant winning any given match is 50%. The matchmaker also will raise your Elo and try to put you in players of equivalent skill, which indirectly tries to get the win rate to 50%. However, it has never looked at your historical win rate and, for example, put you in a game where it knew that you were expected to lose, to end a winning streak, or given you a stomp to end a losing streak.

>246572710

The game looks pretty balanced to me. The Elos are all relatively close. Here are the Elo's on the two teams:

R D
3172 3047
2918 2958
2810 2804
2788 2720
2409 2508

Now it's a pretty big spread between 2409 and 3172, and it is a legitimate question to ask why in the world would we put people together with that big of a skill differential. The answer is that we didn't. The Radiant had a 4-stack which covered that range (the highest and lowest Elos on the Radiant were in the same party). We matched them with two 2-stacks on the Dire. One of the two-stacks had the highest and lowest Elos for the Dire, and the other two stack was in 2 of the middle slots. You were a single who was also in the middle, and there was also a single on the Radiant, also in the middle of the Elo range.

So, the average Elos of all the parties were pretty close. And, player-by-player, each team had somebody on the opposing team of roughly equal skill. Given that 4 stack with the big skill spread, I think it's hard to come up with a better way to get them into a game.

Would you mind being a bit more specific about what you think could have been better?

Note: all of the players had sufficient experience such that we rely almost entirely on Elo. (We do not consider a player with 75 wins to be a "noob".) In this match, there was no correlation between the Win count and the Elo. Perhaps 75 is too low of a number? We have some pretty good data that suggests that it's not. But averages and numbers often don't tell the whole story.

"Noob" is a relative term. We don't consider a person with 150 games to be a "noob". We have some good data that by 75 wins (approx 150 games), Elo is pretty accurate, and so we rely on it almost exclusively at around that point. If you are getting matched with those players, it should be because your Elo is approximately the same. Parties can complicate things considerably. I might be able to provide further insight into why it thought the match would be a good one if you provide a MatchID.

Is 75 the wrong number? Should a person with 2000 wins complain about playing with you, since you are a "noob" with only 1000 wins?

Hi Luna, I think I already did: It was not a great match. Your party of two didn't have any inexperienced players in it, and so you shouldn't have been matched with inexperienced players. (The other experienced players WERE parties with newer players, though.) The 14-win player is borderline smurf, and there might need to be a number that needs some tuning. And he was partied with an experienced player (whose Elo was 1000 points lower, BTW), but still, if you are not partied with an inexperienced player, in general you should not play with an inexperienced player.

I think that the reason that it formed the match is that somebody had been waiting a while, and it needed to fill that last slot, and your party was the best it could find. We're still working on how it decides when to give up.

>246581071

Congrats! You don't have a crappy Elo, and can feel free to keep playing Dota! Your Elo was right in the middle in this game.

You were on the Dire. The Dire had a 2-stack that had an Elo spread of 1000 points. The guy with 150 wins was the bottom half of that party, and the other "noob" with "only" 298 wins was the player in this match with the highest Elo. We paired them against a corresponding party with an Elo spread that was approximately the same on the Radiant.

In summary, it is true that you were matched with a player with an Elo lower than yours, because he was in a party with an average Elo approximately equal to yours. This means that you were also matched with a skilled teammate to compensate for the lower skilled player on your team. (But you didn't know that, because win count is the only metric you have to evaluate the skill of the players in your game, and win count is really not useful past a certain number of wins.) Furthermore, the match was fair because team you played against had a very similar situation. Comparing player-by-player, the teams were balanced, and the match was just about as good as could be formed based on Elo, given the fact that we allow parties to be made with players with differing skill level. Parties CAN cause players with differing skill to be put into the same game. There is no way around that, however, in most cases the matchmaker now does a significantly better job of matching up parties to make equitable teams than it did before.

If you want to avoid this situation and not matched with parties, try the solo queue. We've solved several problems that were causing long wait times and low quality matches. (We should have mentioned that in the patch notes.)

If you party with a noob, it is very likely that you will get matched with a noob. (Very likely it will find another party containing a noob and a player of approximately your skill level and put them on the other team.)

If that situation is not ideal, might I ask who you think you should play against?

Yes, we use a Elo-type system. We have data that shows that it correlates well with a number of quality metrics.

Showing players their Elo has proven to cause a lot of unwanted behaviour. (The same problems exist in Chess.)

We know that there really is value in knowing how the match was formed, and even in knowing which players were the best, and also who was partied up with whom. It helps to analyze your own skill and try to understand how to get better. We are actively working to try to figure out what data we CAN provide to players (perhaps after the match) to help them do this analysis, without causing too many of the undesirable effects I mentioned. Right now, if there's a steamroll, people look at the only data available to them, which is totally understandable. Also, I believe that there have been problems in the past where it was not doing a good enough job segregating truly inexperienced players from experienced players. We've improved on that. However, our definition of "new player" probably doesn't match exactly with many players. (Their definition is often: "the other guy has fewer wins that I do.") And we have to deal with smurfs and players coming in from other games in the genre, where win count is definitely totally unrelated to the skill level of the player.

Just one last comment on this. Elo is a TERRIBLE way to give players a sense of "progress." Many (most?) people reach a plateau, and their Elo stabilizes. It is simply not mathematically possible for Elo to keep increasing in general for players indefinitely as more and more games are played.

Given this reality, if players used Elo to measure "progress", we would constantly be reminding them that they are NOT making any. That would be really bad.


That's hilarious.

Valve's smurf detection is too good now. My 9 win smurf got into a game with 400-1000+ win players. Shit's broken.


It's actually probably too sensitive, that's why you get newer players immediately getting into games with players that are way out of their league. The newer player could just be naturally good and score a few good dominating wins (say 4-5 wins in a row) all of a sudden starts playing against pretty good players.


And what's the problem? If he plays well he clearly deserves to be at that skill level and if he feeds he most likely drops down quite a lot (unless he gets carried).


It should require you to work your way up instead of rocketing you to the top and making you work your way down, that system helps no one.

It's a question of balance.

a) Someone who isn't actually good enough for it is playing at a MMR that's too high. Players in the high bracket get pissed about someone who seems too bad for them.

b) Someone is too good is playing at a MMR that's too low. Players in the low bracket get pissed about someone who is too good for them.


If Valve has to pick between those two I'm with them in believing that b) is the lesser evil. I'd rather get smurfs out of the way of newbs than newbs out of the way of legitimately good players.

Sounds to me like you belive a) is the lesser evil.


I suck at english, cheers. T_T

I'd rather have people playing at a MMR that's too high (meaning they piss off higher level players) than them playing at a MMR that's too low (meaining they piss off low level players).
"We don't make mistakes here, we call it happy little accidents." ~Bob Ross
StoRm_res
Profile Joined March 2011
Switzerland891 Posts
July 19 2013 08:59 GMT
#67153
So mac and linux clients are now available on the main client. Gotta check out how buggy it still is ^^
Cool Cat
Profile Joined June 2009
United States1644 Posts
July 19 2013 09:06 GMT
#67154
pretty buggy yo
ChunderBoy
Profile Joined August 2011
3242 Posts
July 19 2013 09:10 GMT
#67155
On July 19 2013 11:00 FuzzyJAM wrote:
Is tower aggro messed up right now?

Seems like if you remove aggro but then do something to get it again before it's fired a shot it keeps on you even when it should be changing to a creep that's closer and doing the same thing.

Or am I stupid and that's how it's supposed to be and I've somehow not noticed?


yes it is, so is creep aggro since the start of beta but pretty much no one noticed or forgot about this...
in wc3 aggro gets switched immediately, in dota2 towers/creeps finish their last attack then switch on the next one
"mmr is a social construct" - tumblr
rabidch
Profile Joined January 2010
United States20289 Posts
July 19 2013 09:20 GMT
#67156
On July 19 2013 18:10 ChunderBoy wrote:
Show nested quote +
On July 19 2013 11:00 FuzzyJAM wrote:
Is tower aggro messed up right now?

Seems like if you remove aggro but then do something to get it again before it's fired a shot it keeps on you even when it should be changing to a creep that's closer and doing the same thing.

Or am I stupid and that's how it's supposed to be and I've somehow not noticed?


yes it is, so is creep aggro since the start of beta but pretty much no one noticed or forgot about this...
in wc3 aggro gets switched immediately, in dota2 towers/creeps finish their last attack then switch on the next one

i've noticed but i've always just figured it was an intentional change. really annoying for ranged heroes though
LiquidDota StaffOnly a true king can play the King.
Andre
Profile Blog Joined August 2009
Slovenia3523 Posts
July 19 2013 09:23 GMT
#67157
+ Show Spoiler +
EDIT: From April 11th: EricTams advised that changes have been made to the matchmaking algorithms to utilize the number of games played amongst other things. Please base your views on matchmaking after this point.

From http://dev.dota2.com/showthread.php?t=29937

So is this still true or was that labelled a bug in the newest patch? Considering people say smurfs get matched up with 400-1000 people in solo queue it would seem that number of games played doesn't matter anymore.
You must gather your party before venturing forth.
ChunderBoy
Profile Joined August 2011
3242 Posts
July 19 2013 09:24 GMT
#67158
On July 19 2013 18:20 rabidch wrote:
Show nested quote +
On July 19 2013 18:10 ChunderBoy wrote:
On July 19 2013 11:00 FuzzyJAM wrote:
Is tower aggro messed up right now?

Seems like if you remove aggro but then do something to get it again before it's fired a shot it keeps on you even when it should be changing to a creep that's closer and doing the same thing.

Or am I stupid and that's how it's supposed to be and I've somehow not noticed?


yes it is, so is creep aggro since the start of beta but pretty much no one noticed or forgot about this...
in wc3 aggro gets switched immediately, in dota2 towers/creeps finish their last attack then switch on the next one

i've noticed but i've always just figured it was an intentional change. really annoying for ranged heroes though


whether its intentional or not i hate it, much like neutral creeps aggro...
in wc3 pulling/stacking is much harder coz the neutral creeps prioritize hitting you over the creeps. in dota2 its just so passive and boring and unskillful.
"mmr is a social construct" - tumblr
FinestHour
Profile Joined August 2010
United States18466 Posts
July 19 2013 09:31 GMT
#67159
thats open to debate as if it made the game 'boring and unskillful'
thug life.                                                       MVP/ex-
StoRm_res
Profile Joined March 2011
Switzerland891 Posts
July 19 2013 09:46 GMT
#67160
On July 19 2013 18:06 Cool Cat wrote:
pretty buggy yo


yeah, I get like 10 fps even though I can run it on parallels on almost highest settings. Seems like I have to wait some more until it gets playable
Prev 1 3356 3357 3358 3359 3360 6534 Next
Please log in or register to reply.
Live Events Refresh
BSL
19:00
S23 - Announcement Showmatch
Ret vs TerrOr
DragOn vs StRyKeR
ZZZero.O126
LiquipediaDiscussion
[ Submit Event ]
Live Streams
Refresh
StarCraft 2
JuggernautJason83
SpeCial 69
StarCraft: Brood War
Artosis 672
Shuttle 508
ZZZero.O 126
NaDa 29
Dota 2
monkeys_forever432
NeuroSwarm143
League of Legends
Doublelift7016
JimRising 540
Heroes of the Storm
Grubby3002
Khaldor226
Other Games
summit1g9518
FrodaN3636
Liquid`RaSZi2595
KnowMe266
Mew2King61
CosmosSc2 19
Livibee14
[ Show 13 non-featured ]
StarCraft 2
• Hupsaiya 95
• mYiSmile127
• AfreecaTV YouTube
• intothetv
• Kozan
• IndyKCrew
• Migwel
StarCraft: Brood War
• BSLYoutube
• STPLYoutube
• ZZZeroYoutube
Dota 2
• masondota21981
Other Games
• Scarra920
• imaqtpie548
Upcoming Events
Replay Cast
44m
Afreeca Starleague
10h 44m
Shine vs Rush
WardiTV Weekly
11h 44m
Monday Night Weeklies
16h 44m
Sparkling Tuna Cup
1d 10h
Afreeca Starleague
1d 10h
Light vs EffOrt
OSC
1d 12h
PiGosaur Cup
2 days
Kung Fu Cup
2 days
The PondCast
3 days
[ Show More ]
Replay Cast
4 days
Korean StarCraft League
5 days
CranKy Ducklings
5 days
GSL
6 days
Yamato Cup
6 days
Liquipedia Results

Completed

K-JUNGMAN
Blizzard Classic Cup 2026
Big Dog Cup 2026 Div 1

Ongoing

ASL Season 22
Super Anchor Qualifying S3
CSL 2026 AUTUMN (S22)
Acropolis #5
Acropolis #5 - GSA
Calamity Invitational
Logitech G Play Connect 2026
SL StarSeries Fall 2026
FISSURE Playground #3
BLAST Open Fall 2026
Esports World Cup 2026
BLAST Bounty Summer 2026
BLAST Bounty Summer Qual
Stake Ranked Episode 3
XSE Pro League 2026

Upcoming

Acropolis #5 - GSB
Acropolis #5 - GSC
SC4ALL II: Brood War
BSL 23: Non-Korean Championship
HSC XXX
Stellar Fest 2: Lunar Cup
SC4ALL II: StarCraft II
Kung Fu Cup 2026 Grand Finals
RSL Offline Finals
Copium Cup
PGL Major Singapore 2026
Stake Ranked Episode 6
BLAST Rivals Fall 2026
IEM Beijing 2026
Stake Ranked Episode 5
PGL Masters Bucharest 2026
1win Private Club #2
Thunderpick World Champ. '26
ESL Pro League Season 24
Stake Ranked Episode 4
1win Private Club #1
TLPD

1. ByuN
2. TY
3. Dark
4. Solar
5. Stats
6. Nerchio
7. sOs
8. soO
9. INnoVation
10. Elazer
1. Rain
2. Flash
3. EffOrt
4. Last
5. Bisu
6. Soulkey
7. Mini
8. Sharp
Sidebar Settings...

Advertising | Privacy Policy | Terms Of Use | Contact Us

Original banner artwork: Jim Warren
The contents of this webpage are copyright © 2026 TLnet. All Rights Reserved.