From the 100 games I've launched:
72 close positions
11 close air
17 cross
To me that's pretty conclusive. Does anyone know why there may be a bias towards spawning in close positions?
User was banned for this post.
Forum Index > SC2 General |
I apologize to everyone in this thread for taking the OP seriously. My mod senses are definitely off today. -- Chill | ||
the p00n
Netherlands615 Posts
From the 100 games I've launched: 72 close positions 11 close air 17 cross To me that's pretty conclusive. Does anyone know why there may be a bias towards spawning in close positions? User was banned for this post. | ||
ch33psh33p
7650 Posts
| ||
Lonyo
United Kingdom3884 Posts
| ||
skirmisheR
Sweden451 Posts
![]() | ||
nkr
Sweden5451 Posts
![]() | ||
Moonstruck
20 Posts
try a 1000 to 10k | ||
Toast.yum
51 Posts
| ||
fabiano
Brazil4644 Posts
No one is ever going to manually launch 1000 to 10000 replays -_- | ||
Playguuu
United States926 Posts
Ninja'd^^ | ||
magha
Netherlands427 Posts
On February 16 2011 04:50 Toast.yum wrote: nkr: Yes it is Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. | ||
Dimagus
United States1004 Posts
- The random number generator is not as random as Blizzard thought - The algorthim to generate starting locations is flawed or it could be both. | ||
DamnCats
United States1472 Posts
But no that is quite odd indeed. | ||
the p00n
Netherlands615 Posts
| ||
TigerKarl
1757 Posts
| ||
![]()
NonY
8748 Posts
On February 16 2011 04:52 magha wrote: Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. I hope you are agreeing with Toast.yum and making the additional point that an appropriate sample size is specific to the situation. | ||
emythrel
United Kingdom2599 Posts
On February 16 2011 04:48 skirmisheR wrote: I think 100 games is enough if you get that extreme results from it, but really 72? That's sick, could someone else do the same thing? ![]() The thing is that while there are 3 possibilities of positions, close ground, close air, cross. Each time you load up a game it has equal chance to roll any of them, completely independent of previous rolls, that means it will never go 33% under any sample size..... it could be 99% close ground positions in theory, thats the wonderful thing about randomness. While its not completely random, no RNG can be completely random, only as random as you can program it to be. If I did a 100 game sample, and someone else did the same, the most likely result would be that our spawn ratios are completely different. I know that for the most part when i play metal I get cross positions, but you might air air positions, and playerX gets a fairly even mix. All of our results are completely independent of the other and therefore under a RNG we should get different results each time we run a test. The sample size needed to get an RNG to even out distribution of events is unfathomable, billions if not trillions or perhaps a google games could have to be loaded before it evens out | ||
Fallen33
United States596 Posts
| ||
Frozenserpent
United States143 Posts
Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. | ||
magha
Netherlands427 Posts
On February 16 2011 04:56 Liquid`Tyler wrote: Show nested quote + On February 16 2011 04:52 magha wrote: On February 16 2011 04:50 Toast.yum wrote: nkr: Yes it is Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. I hope you are agreeing with Toast.yum and making the additional point that an appropriate sample size is specific to the situation. That's exactly what I ment, yes | ||
RoyalCheese
Czech Republic745 Posts
![]() | ||
ch33psh33p
7650 Posts
| ||
eLiE
Canada1039 Posts
I'll give the book example for clarity. If you flip a coin and it lands on one side 9 times out of 10, you can assume that the coin is likely rigged. Any less, and it's more likely that the coin landed the way it did due to chance. EDIT: frozenserpent beat me to it, but a higher sample size always improves generalizability | ||
Deja Thoris
South Africa646 Posts
On February 16 2011 04:52 magha wrote: Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. I get your point but the sample size could increase to 1,000 and show the same trend, both in terms of starting positons and lottery winners. It proves that 100 or 1000 is an appropriate sample size for what he wanted to do. More is always better but sometimes enough is enough. | ||
Zedders
Canada450 Posts
On February 16 2011 04:52 magha wrote: Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. there is a 1 in 1 million ++++ chance to win a lotttery ticket usually....theres a 1/3 chance that you will spawn close positions... | ||
ALPINA
3791 Posts
On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. Sample size of 100 proves nothing. Don't call people retarded and get a clue about what you are talking. | ||
Lonyo
United Kingdom3884 Posts
21 close positions 15 close air 17 cross Which is pretty reasonable for random. All ladder games, saved indiscriminantly (I save all my replays). So @ OP, it's just you, although I did notice that it was a lot more even form the earlier replays (the 53 came from October to January). | ||
mesohawny
Canada193 Posts
I don't know why people are bothering to categorize close-air and "close"... they're both close, ones just a little closer by air... the ground distance is roughly the same... in this case the close positions would make up 3/4 of the games because there are more possibilities to spawn close positions, rather than just the ONE (or two if you count the reverse) for cross-positions. someone correct me if im wrong. | ||
TBO
Germany1350 Posts
On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. | ||
tealc
109 Posts
| ||
Lobotomist
United States1541 Posts
| ||
Soma.bokforlag
Sweden448 Posts
On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. | ||
thrawn2112
United States6918 Posts
| ||
Immersion_
United Kingdom794 Posts
| ||
Deadeight
United Kingdom1629 Posts
On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. I know that if you analyse it statistically 100 samples is enough. The chance of getting that ratio is pretty low. And as Frozenserpent said the P value would be low. But (if I understand OPs post correctly) the sample was not random. He looked at his last 100 games that he'd played on it right? Or did he play an extra 100 games? Out of all the people who play it's pretty likely that this will have happened to someone. And when it does happen to someone that person will notice it. Would be good if there was a way to check this without checking individual replays. | ||
aristarchus
United States652 Posts
| ||
![]()
NonY
8748 Posts
On February 16 2011 05:02 TBO wrote: Show nested quote + On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. On February 16 2011 05:05 Soma.bokforlag wrote: Show nested quote + On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. | ||
Algar
United States27 Posts
I'm just glad to see other people as frustrated with these types of responses as I usually am. | ||
eLiE
Canada1039 Posts
On February 16 2011 05:02 TBO wrote: Show nested quote + On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. It doesn't matter who plays the games because the random spawn placement is standardized, and you're just looking at whether the map generally spawns people at close positions. It doesn't make sense that it would randomly pick people to always spawn close, and it's more likely to be a general problem, if there even is one (I don't think there is). And I wouldn't say 6 out of 100,000 people is a lot. That's 0.00006% of people hitting the jackpot, statistically insignificant. | ||
![]()
NonY
8748 Posts
On February 16 2011 05:09 aristarchus wrote: TBO wins the thread. This is definitely a statistically significant result, but I still don't believe it. Lots of people probably try this stuff, and a small number get really weird results and then post here. (This is a problem with academic research too - the way you settle it is to do more tests independently, and also to have some healthy skepticism about the likelihood that blizzard screwed something this simple up in that weird a way in the first place.) How does he win the thread? While he makes a relevant point, he hasn't provided the data to prove that the phenomenon he claims is happening is actually happening. At the moment, he's relying on faith that nothing has caused a problem in SC2's ability to give random positions on Metalopolis. | ||
ALPINA
3791 Posts
On February 16 2011 05:09 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. Show nested quote + On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. So he could still be wrong, 100 games cannot prove anything, can they? People are saying that even if the chance of getting close positions is 1/3 the statistics made from 100 games can still be wrong.. | ||
Malloy
Canada166 Posts
If each possible position setup (close air, close ground, cross) are exactly 33% likely...then it's quite possible to get many of the same setup in a row. Those that claim that the probability decreases with each successive match are wrong...chances will remain 33%; http://en.wikipedia.org/wiki/Gambler's_fallacy Selecting an appropriet sample size is actually something that can be quite difficult. I'd suggest a sample size of 2,000 in order to generate a confidence level of 99%. 1,000 for a 95% confidence level. (A confidence of 100% is not possible) | ||
Deadeight
United Kingdom1629 Posts
On February 16 2011 05:08 Deadeight wrote: Show nested quote + On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. I know that if you analyse it statistically 100 samples is enough. The chance of getting that ratio is pretty low. And as Frozenserpent said the P value would be low. But (if I understand OPs post correctly) the sample was not random. He looked at his last 100 games that he'd played on it right? Or did he play an extra 100 games? Out of all the people who play it's pretty likely that this will have happened to someone. And when it does happen to someone that person will notice it. Would be good if there was a way to check this without checking individual replays. On February 16 2011 04:45 the p00n wrote: I found this pretty weird so I actually started testing it against the computer. On February 16 2011 05:09 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. Show nested quote + On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. My bad. | ||
Meta
United States6225 Posts
On February 16 2011 05:09 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. Show nested quote + On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. Could still be coincidence. The problem with this "test" is that it is a single sample, although the sample size is fairly large. Accurate conclusions can't be reached unless more samples like this one are taken. I haven't conducted the hypothesis test for this sample but it's likely that he'd get a p-value less than 0.05. However, this particular sample could just be an outlier. Many more samples like this one would need to be taken to draw conclusions. Is that asking too much? Probably, but until it happens this sample really doesn't conclude anything. | ||
Natt
France253 Posts
Close : 16 Air : 14 Cross : 15 Total : 45 games As you can see, that's pretty equal. However on the past month, i've had way more close position, but i cant draw conclusion from that. | ||
Yoshi Kirishima
United States10343 Posts
Sample size of 100 proves nothing. Don't call people retarded and get a clue about what you are talking. Thank you. Because isn't randomness random? You can never be sure. Even a million tests may still prove to get a 7:1:2 ratio. You never know! | ||
Vei
United States2845 Posts
On February 16 2011 04:52 magha wrote: Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. Lol Lotto winning chances should theoretically be 1/# of ticket buyers. Close Spawn chances should theoretically by 1/3 nice analogy man | ||
iamke55
United States2806 Posts
On February 16 2011 05:01 Alpina wrote: Show nested quote + On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. Sample size of 100 proves nothing. Don't call people retarded and get a clue about what you are talking. While I don't agree with calling people "fucking retarded", you need a better understanding of statistics before you tell people to get a clue. Sample size doesn't mean anything, it's p-value that matters. And you don't even need to calculate the p-value to know it's way less than 0.05 if something happens 72 times out of 100 when its expected value is 33. | ||
sob3k
United States7572 Posts
On February 16 2011 05:12 Alpina wrote: Show nested quote + On February 16 2011 05:09 Liquid`Tyler wrote: On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. So he could still be wrong, 100 games cannot prove anything, can they? People are saying that even if the chance of getting close positions is 1/3 the statistics made from 100 games can still be wrong.. You can ALWAYS be wrong. The thing is, with these possible outcomes and this samples size test, its extremely unlikely. | ||
Ghad
Norway2551 Posts
On February 16 2011 04:59 RoyalCheese wrote: because : ![]() Hahahahahahaha, I don't know why, but I cannot stop rofling from that. | ||
Lush
United States657 Posts
As for the actual point of this thread, I hate this. It is Statistically significant, and strategically as well. Close positions always leads to a super gay cheese fest in my experience. I fist pump everytime I spawn cross position, and I can either 15pool 16 hatch, 1 rax expo, or gate cyber expo. Making it to the mid/late game can be difficult on close positions. Not saying it's difficult to win, it's just less fun to play in my opinion. | ||
![]()
NonY
8748 Posts
On February 16 2011 05:12 Alpina wrote: Show nested quote + On February 16 2011 05:09 Liquid`Tyler wrote: On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. So he could still be wrong, 100 games cannot prove anything, can they? People are saying that even if the chance of getting close positions is 1/3 the statistics made from 100 games can still be wrong.. You are correct to say that it's wrong to utter the words proof and conclusion at this point, but the 100 game sample size shows that it's more likely than not (>50% chance) that close positions happen more than 1/3 of the time. edit: And yeah, it's a lot higher than 50%, but since I haven't done the math I don't know what it is exactly and will leave that to someone else. | ||
ScrubS
Netherlands436 Posts
| ||
Deadlyfish
Denmark1980 Posts
![]() | ||
Soma.bokforlag
Sweden448 Posts
On February 16 2011 05:09 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. Show nested quote + On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. indeed, sorry, i just wanted to lecture him for calling people retarded ![]() | ||
huameng
United States1133 Posts
That being said, someone else should recreate this test before concluding something is wrong. | ||
dc302
Australia576 Posts
| ||
Novembermike
United States102 Posts
| ||
Centorian
United States95 Posts
Run 100 games against the computer and post your results. I'm not at home right now so I can't do it, or I would. Statistically 100 is enough of a sample size. However there is still like a 5% chance that his numbers are off due to statistical error. In a scientific study though, if you disagree with the original author of the study, its your job to run his test and show that your results are not in alignment with his. -Cent | ||
![]()
Chill
Calgary25980 Posts
a) Figure out how we're going to test it with a larger sample size; or, prefereably b) Figure out why Metalopolis is prone to spawning clone positions. | ||
Aerakin
185 Posts
On February 16 2011 05:15 Vei wrote: Lotto winning chances should theoretically be 1/# of ticket buyers. Depends. If it's instant lottery, yeah. But anything where you can chose numbers, it's quite possible to have no winners | ||
Deadeight
United Kingdom1629 Posts
I'm going to start looking through my replays and I'll post here my results. | ||
MonsieurGrimm
Canada2441 Posts
On February 16 2011 05:20 Chill wrote: Interesting. Instead of arguing about the reasonable sample size, let's either: a) Figure out how we're going to test it with a larger sample size; or, prefereably b) Figure out why Metalopolis is prone to spawning clone positions. We could make a new thread about it, and have people put their names in and have everyone do a sample of 10-20 then report back to the thread so nobody has to waste an hour on it... | ||
![]()
Chill
Calgary25980 Posts
| ||
MorroW
Sweden3522 Posts
they should make it like shakuras ![]() | ||
Wolf
Korea (South)3290 Posts
| ||
philcorp
Canada32 Posts
| ||
eLiE
Canada1039 Posts
On February 16 2011 05:16 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:12 Alpina wrote: On February 16 2011 05:09 Liquid`Tyler wrote: On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. So he could still be wrong, 100 games cannot prove anything, can they? People are saying that even if the chance of getting close positions is 1/3 the statistics made from 100 games can still be wrong.. You are correct to say that it's wrong to utter the words proof and conclusion at this point, but the 100 game sample size shows that it's more likely than not (>50% chance) that close positions happen more than 1/3 of the time. edit: And yeah, it's a lot higher than 50%, but since I haven't done the math I don't know what it is exactly and will leave that to someone else. Tyler, it seems like you are taking a personal interest in figuring out whether there is increased close spawning? Is this something you're experiencing? As for the results, you really can't draw anything from them because this is a sample of 100 out of freaking a shmajillion games (the population) played on metalopolis. You'd need access to blizz stats to really figure out how random the draw is. EDIT: well with that edit, I suggest we infiltrate blizz, or get a hundred people to do a hundred games, then pool dem results. | ||
![]()
Chill
Calgary25980 Posts
On February 16 2011 05:22 Wolf wrote: Can't you look up the spawn location percentage chances in editor? Or, better yet, isn't it the same for all maps? 100%/number of spawn locations? We know Blizzard can eliminate spawns (see: Shakuras Plateau). I think the implication is that the programming says it should be random, but testing shows it isn't. | ||
Vei
United States2845 Posts
On February 16 2011 05:21 MorroW wrote: i spawn close on metal like 50% of my games. maybe im just being biased cause im zerg and only remember the bad luck but still they should make it like shakuras ![]() Sums up all my thoughts :> Interesting. I wonder if metalop recently got changed, because I used to get more cross-spawn ^^ On February 16 2011 05:22 Chill wrote: Show nested quote + On February 16 2011 05:22 Wolf wrote: Can't you look up the spawn location percentage chances in editor? Or, better yet, isn't it the same for all maps? 100%/number of spawn locations? We know Blizzard can eliminate spawns (see: Shakuras Plateau). I think the implication is that the programming says it should be random, but testing shows it isn't. Perhaps they never intended for all maps to be equal spawns; in Shakuras it's obviously a (what I presume to be) 50-50-0 ratio for spawns; the could've stealth patched or something Metalop to make it 50-30-20 or something (close/air/cross). They haven't necessarily said they want spawns to be X, even in the case of shakuras... unless I'm mistaken which I may be, seeing as how I don't follow blue posts except what's reposted here. | ||
JTouche
United States239 Posts
Thumbs up Blizz ![]() | ||
Harmonious
179 Posts
On February 16 2011 04:57 emythrel wrote: The thing is that while there are 3 possibilities of positions, close ground, close air, cross. Each time you load up a game it has equal chance to roll any of them, completely independent of previous rolls, that means it will never go 33% under any sample size..... it could be 99% close ground positions in theory, thats the wonderful thing about randomness. While its not completely random, no RNG can be completely random, only as random as you can program it to be. The funny thing about true randomness is that it doesn't look as random as it could be to people. If you ask someone to write down 100 random numbers between 1 and 10 you can probably tell that it is not random since there aren't enough sequences of stuff (avoid saying patterns since there aren't patterns in randomness). Sequences would be 5,5,5,5,5 or 1,2,3,4,5,6,7 and so on. A true random sequence would have quite a few of those. Just a funny fact. In this case I think we can say with a pretty high confidence that something is up. Maybe between 60 and 80 percent (look up confidence intervals etc. if you want more details). I would certainly not bet my life on the fact that something is amiss. If TL is up for an experiment we could always flip two coins 100 times and compare results. I can pretty much guarantee that some very "skewed" results would appear. | ||
SiguR
Canada2039 Posts
On February 16 2011 05:21 MorroW wrote: i spawn close on metal like 50% of my games. maybe im just being biased cause im zerg and only remember the bad luck but still they should make it like shakuras ![]() I actually have had similar experiences. Before this thread was made I always felt like there were many more close position spawns occurring than otherwise. I previously would ignore the notion and put it down to the odds just working out that way. | ||
Twistacles
Canada1327 Posts
| ||
thrawn2112
United States6918 Posts
On February 16 2011 05:20 Chill wrote: Interesting. Instead of arguing about the reasonable sample size, let's either: a) Figure out how we're going to test it with a larger sample size; or, prefereably b) Figure out why Metalopolis is prone to spawning clone positions. Maybe it would be useful to bring the argument to a conclusion, just so teamliquid can set some standards for posting statistical analysis. Of course internet + arguments = fail, especially when the majority of people on here have never taken a college level stats class. If I were to ever open a thread about sc2 related statistics and see words like null hypothesis, p value, etc with values assigned and work shown.......who am I kidding lol. | ||
DueSs
United States765 Posts
| ||
Centorian
United States95 Posts
Play metalopolis against the computer for one game. Answer poll according to your result. However, it would be easy enough for people to lie, or use the poll based on their feelings and not actually doe the test. | ||
Draconicfire
Canada2562 Posts
On February 16 2011 05:26 Centorian wrote: A poll could work to get a lot of information very quickly. Play metalopolis against the computer for one game. Answer poll according to your result. However, it would be easy enough for people to lie, or use the poll based on their feelings and not actually doe the test. What if we started a research thread where people can post their replays on Metal and then tally it from there? The only issue I see is if the same two people post the same replay, so it would count twice. | ||
italiangymnast
United States246 Posts
Poll: What spawn position did you get? Close Ground (53) Close Air (23) Far (23) 99 total votes Your vote: What spawn position did you get? | ||
sikyon
Canada1045 Posts
On February 16 2011 05:24 Twistacles wrote: Do replay files have, hard-coded into them, some variable that stores spawn location? Because if it did, it wouldn't be too hard to code an application to go through a bunch of replay files. This is what I was thinking. SC2replayed can parse your replay by race and even BO, so can we not create some program that can parse replays by spawn position? I don't have the time to look into it but that would be pretty neat, and we could download a bunch of replays off replay sites to analyze the sample. | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:09 Liquid`Tyler wrote: Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. That's not the whole story. It's possible that thousands of people are bothered enough by the observed frequencies to run tests. Of these only one leads to exceptional result and it's the only one that gets reported. OPs testing method is correct from his point of view, but underlying "drawer effect" should change how we interpret his result. Anyway, to add some math to the discussion, taking a binomial distribution with p=1/3 the expected number of successes is 33.3 (duh) with a standard deviation of sqrt[np(1-p)]=4.7 So OPs result deviates from the expected by 8 standard deviations, pretty much killing any discussion about publication bias or sample size. | ||
MonsieurGrimm
Canada2441 Posts
On February 16 2011 05:28 Draconicfire wrote: Show nested quote + On February 16 2011 05:26 Centorian wrote: A poll could work to get a lot of information very quickly. Play metalopolis against the computer for one game. Answer poll according to your result. However, it would be easy enough for people to lie, or use the poll based on their feelings and not actually doe the test. What if we started a research thread where people can post their replays on Metal and then tally it from there? The only issue I see is if the same two people post the same replay, so it would count twice. Shouldn't happen if they play vs a computer, sounds like a good idea. Another problem is people could selectively give replays of them spawning in a certain position but I see no reason why someone would do that.. | ||
Centorian
United States95 Posts
[QUOTE]On February 16 2011 05:26 Centorian wrote: The only issue I see is if the same two people post the same replay, so it would count twice.[/QUOTE] This isn't an overwhelmingly large problem if we have a large sample size. It not a confounding third variable because it doesn't affect close/air/far ratio. It decreases accuracy, but it won't disfigure the results. | ||
gaheris
Ireland12 Posts
On February 16 2011 05:26 DueSs wrote: Ah, I enjoy the banter--but really this is just measuring statistics-dick sizes. The OP just tried something as a hunch and posted his results. It's interesting and perhaps more valuable as something that might be a real thing. It instigates discussion and intrigue. It's a good thing. ahh but would he have posed anything if his results were within the norm?? | ||
Harmonious
179 Posts
On February 16 2011 05:21 MonsieurGrimm wrote: We could make a new thread about it, and have people put their names in and have everyone do a sample of 10-20 then report back to the thread so nobody has to waste an hour on it... This is a good idea, but we need to be a bit careful about it. For example only count the first 50 people or 100. And this must be decided before counting starts. Won't make a huge difference, but since this is almost a survey, it is important to be strict about what you are measuring. Otherwise you can keep measuring until you get the answer you want. I just like rigour. ![]() | ||
Yoshi Kirishima
United States10343 Posts
That's not the whole story. It's possible that thousands of people are bothered enough by the observed frequencies to run tests. Of these only one leads to exceptional result and it's the only one that gets reported. OPs testing method is correct from his point of view, but underlying "drawer effect" should change how we interpret his result. Yup good point. People have to remember this when they look at polls and surveys too. Etc. OK guys i have an idea. Everyone Start up ONE game against the computer! then vote in this pole with which spawn you got. This could increase the sample size by alot. Haha good idea, fast and convenient! Edit: Air :D | ||
JoeSchmoe
Canada2058 Posts
On February 16 2011 05:29 italiangymnast wrote: OK guys i have an idea. Everyone Start up ONE game against the computer! then vote in this pole with which spawn you got. This could increase the sample size by alot. Poll: What spawn position did you get? Close Ground (53) Close Air (23) Far (23) 99 total votes Your vote: What spawn position did you get? I'm already going to call bullshit on the first couple of votes. I refreshed the page and the poll just came up with no votes. I refreshed 2 seconds later and there were 2. Clearly they did not start a game against the computer like was instructed. | ||
aristarchus
United States652 Posts
On February 16 2011 05:12 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:09 aristarchus wrote: TBO wins the thread. This is definitely a statistically significant result, but I still don't believe it. Lots of people probably try this stuff, and a small number get really weird results and then post here. (This is a problem with academic research too - the way you settle it is to do more tests independently, and also to have some healthy skepticism about the likelihood that blizzard screwed something this simple up in that weird a way in the first place.) How does he win the thread? While he makes a relevant point, he hasn't provided the data to prove that the phenomenon he claims is happening is actually happening. At the moment, he's relying on faith that nothing has caused a problem in SC2's ability to give random positions on Metalopolis. I'm not sure what data he could possibly provide. He's saying that probably a lot more people than this have runs of bad luck and then say "Oh, I'll test this out." Of those people, some number will get statistically significant results even if there's nothing to find. Given the frequency of people on team liquid (the website, not the team) doing this sort of stuff, I think it's a pretty reasonable bet that lots of people try stuff like this and then find nothing and don't post about it. I'm not trying to say this shouldn't be investigated further, just that I think it's reasonable to see the false positive scenario as the more likely scenario. Remember that the other scenario involves blizzard failing to implement a simple rng correctly, and then thousands of other players never noticing that metalopolis spawns close positions with double the frequency it should. (If it was only off by one or two percentage points, it wouldn't explain these numbers at all.) If you want to solve the problem TBO is talking about, you need to make sure that whoever is doing the confirming experiments for this result will report their results either way. Clearly people should test it themselves, but they should commit to doing so and posting the results regardless of what they find, so that this bias of only seeing significant results can't explain the findings. | ||
italiangymnast
United States246 Posts
| ||
Harmonious
179 Posts
On February 16 2011 05:31 gaheris wrote: Show nested quote + On February 16 2011 05:26 DueSs wrote: Ah, I enjoy the banter--but really this is just measuring statistics-dick sizes. The OP just tried something as a hunch and posted his results. It's interesting and perhaps more valuable as something that might be a real thing. It instigates discussion and intrigue. It's a good thing. ahh but would he have posed anything if his results were within the norm?? This is a real problem in science and it is called publication bias. Look it up on wikipedia for example. Say you have an idea for cold fusion. You then discover it is not possible for reason X. This is actually relevant information for the community, but it won't get published because the research "didn't go anywhere". | ||
Centorian
United States95 Posts
On February 16 2011 05:33 JoeSchmoe wrote: Show nested quote + On February 16 2011 05:29 italiangymnast wrote: OK guys i have an idea. Everyone Start up ONE game against the computer! then vote in this pole with which spawn you got. This could increase the sample size by alot. Poll: What spawn position did you get? Close Ground (53) Close Air (23) Far (23) 99 total votes Your vote: What spawn position did you get? I'm already going to call bullshit on the first couple of votes. I refreshed the page and the poll just came up with no votes. I refreshed 2 seconds later and there were 2. Clearly they did not start a game against the computer like was instructed. Yeah the issue is people lying. Need to do something that involves posting replays. Which means it works easier if people do more than one. | ||
Playguuu
United States926 Posts
Unless you want to explore the possibility that results are being skewed based on races, start times, mmrs, random number defect, etc. I don't think you can make any conclusions on 1 result. Who is to say the next 100 games you play aren't skewed in some other fashion and the OP didn't just get a bad string of close positions? | ||
Deadlyfish
Denmark1980 Posts
On February 16 2011 05:36 Centorian wrote: Show nested quote + On February 16 2011 05:33 JoeSchmoe wrote: On February 16 2011 05:29 italiangymnast wrote: OK guys i have an idea. Everyone Start up ONE game against the computer! then vote in this pole with which spawn you got. This could increase the sample size by alot. Poll: What spawn position did you get? Close Ground (53) Close Air (23) Far (23) 99 total votes Your vote: What spawn position did you get? I'm already going to call bullshit on the first couple of votes. I refreshed the page and the poll just came up with no votes. I refreshed 2 seconds later and there were 2. Clearly they did not start a game against the computer like was instructed. Yeah the issue is people lying. Need to do something that involves posting replays. Which means it works easier if people do more than one. You cant stop people from lying if they really want to. They could just post a few extra close position replays and trick you that way. | ||
Deyster
Jordan579 Posts
I'm gonna assume this, it is probably not how spawning positions are decided. I just assumed it for the sake of explaining. Let's assume this, the game at first decides where Player A spawns, then where Player B. 1. At first, a random number between 1-120 is generated (RNG-A). * If [1 = RNG-A > 31] Then player A spawns at 1st position. * If [31 = RNG-A > 61] Then player A spawns at 2nd position. * If [61 = RNG-A > 91] Then player A spawns at 3rd position. * If [90 > RNG-A = 120] Then player A spawns at 4th position. Now how the 2nd spawning position is decided could probably be done by 2 methods that I can think of on the top of my head, one is redoing the same as 1st step and in case the RNG-B range is the same as RNG-A, then RNG-B is regenerated again until a number in different region is given then the 2nd spawning point is decided, or it could be decided by what I would use if I was to code it, which is: 2. Reassign the remaining spawning points to 1st-B, 2nd-B and 3rd-B. * If [1 = RNG-B > 41] Then player B spawns at 1st-B position. * If [41 = RNG-B > 81] Then player B spawns at 2nd-B position. * If [80 > RNG-B = 120] Then player B spawns at 3rd-B position. With this method of deciding spawning positions, the game doesn't take into consideration where Player-A spawns to determine where Player-B spawns other than the fact that both players can't have the same spawning position. RNG is just random, sometimes you get a streak of repeated values due to the equation the coder used to generate the RNG. I remember my days when I played WoW and we'd get the same loot from bosses for weeks eventhough according to Blizzard, all the loot had the same drop chance. | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:33 aristarchus wrote: I'm not sure what data he could possibly provide. He's saying that probably a lot more people than this have runs of bad luck and then say "Oh, I'll test this out." Of those people, some number will get statistically significant results even if there's nothing to find. Given the frequency of people on team liquid (the website, not the team) doing this sort of stuff, I think it's a pretty reasonable bet that lots of people try stuff like this and then find nothing and don't post about it. I'm not trying to say this shouldn't be investigated further, just that I think it's reasonable to see the false positive scenario as the more likely scenario. Remember that the other scenario involves blizzard failing to implement a simple rng correctly, and then thousands of other players never noticing that metalopolis spawns close positions with double the frequency it should. (If it was only off by one or two percentage points, it wouldn't explain these numbers at all.) If you want to solve the problem TBO is talking about, you need to make sure that whoever is doing the confirming experiments for this result will report their results either way. Clearly people should test it themselves, but they should commit to doing so and posting the results regardless of what they find, so that this bias of only seeing significant results can't explain the findings. It's always possible that the reported results will be so extreme that it's significant even if all negative results remain unreported. Sure, good protocol is essential if you want to get a very accurate result or the effect is smallish. But if it's blatantly obvious (as it is, if OPs numbers are actually accurate) then you can be more casual about it and still be confident in your conclusion. | ||
TBO
Germany1350 Posts
On February 16 2011 05:09 Liquid`Tyler wrote: Show nested quote + On February 16 2011 05:02 TBO wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. The problem here is that you have millions of players who play 100 games on metalopolis and a few of them will get extreme results (and those will post in the forums), even if it is 1/3 chance. If you have 100.000 people throwing a coin 15 times, you will get quite a few (6 in average) who will get a 15-0 or 0-15 result. Only if lots of people get the same results as the topic creator, one could assume it is conclusive. Show nested quote + On February 16 2011 05:05 Soma.bokforlag wrote: On February 16 2011 04:58 Frozenserpent wrote: People are fucking retarded and need to learn some basic statistics before they say something like "not big enough sample size". Even 50 can be sufficient to obtain a p-value < 5%. In this case, p-value is definitely low enough to reject the assumption that it's 1/3rd. Obviously if you want the exact ratios you'd want to expand on the larger sample size, but this is conclusive to determine that it's not 1/3rds. you shouldnt call people retarded when you obviously doesnt understand statistics. if you make enough studdies some of them will turn out faulty results even if the method is correct 99.9% of the time. in this example, it is possible that the author of the thread felt "damn, i get alot of close positions" and therefore examined his stats.. the rest 99.99% of players which have a more even distribution never gave it a thought and probably are closer to correct ratios edit. TBO was quicker than me.. Ah, you guys aren't likely to get your PHD's when you can't even understand the OP's testing methods. He didn't examine the games that gave him the feeling that he got close positions. He got that feeling and ignored those games and loaded up 100 more games against the computer and recorded those results. My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Only way to really find a conclusive result is to just have a few more runs with a sample size of 100 (actually smaller sample size like 50 should be fine as well if we just run enough of them). Just wanted to start my sample, and then realized that to find out which spots you are you need to scout, which takes a lot of time... I think it would be useful to create a custom map which has fog of war disabled. Or is there a singleplayer cheat which removes FoW? (That assumes that singleplayer positioning is based on the same algorithm, which it should be) | ||
silencesc
United States464 Posts
Class I'll do this and edit the post with results. Anyone else down? | ||
legendre20
United States316 Posts
| ||
Ihle
Norway36 Posts
On February 16 2011 04:52 magha wrote: Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. This is just wrong. If the OP has is not screwing with us. and if the different trys are independent, getting 72 out of a hundred given that the probability is 1/3 i far more unlikely than winning the lottery. A standart p-test with x=72 and n=100 and p0= 1/3, will give you a p value of 1.19*10^-16 (thats very low for people who dont know math) The p-value is the likelyhood that the real probability is p0 (or less) http://en.wikipedia.org/wiki/P-value So this means that either the OP made a mistake in the test or blizzard has made a mistake in the algorithm. | ||
lightwing
Netherlands33 Posts
![]() | ||
sob3k
United States7572 Posts
| ||
![]()
motbob
![]()
United States12546 Posts
| ||
Krissam
Denmark189 Posts
On February 16 2011 04:52 magha wrote: Taking sample sizes of 100 would prove that nobody in history has ever won a lottery. but the lottery has a fuckton more outcomes than metal spawns User was warned for this post | ||
Isomer
United States186 Posts
S is the "sample space," or the outcomes you can have. So, that's close-ground, close-air, cross. S={G, A, C} An "event" is an outcome or set of outcomes of a random phenomenon. In this case, it's the 72 close, 17 air, 11 cross. We can call OP's event OP= {CCCC...AAA...GGGG} There are obviously millions of possible events given 100 outcomes and a sample space of 3 equally likely outcomes. To find out how likely getting 72 close positions is, one might simply use the following formula: (total games)! / (number of positions^number of games) (close positions!) (total games-close positions!) This gives us: 100! / 3^100 (72!)(28!) = 9 x 10^-24 So, it's highly unlikely that if these three outcomes are equally probable, then there will be an event with 72 of one outcome. Not to reduce the sort of "legitimacy" of this discussion, but I don't know that we should necessarily put that much stock in the experience of one person. It is unverifiable that OP got 72 - he can claim it, but we all know of the existence of trolls. If we want this to be legitimate, maybe 10-15 other people can load up a few games to see what they get. | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^16 which sounds about right. | ||
DiaBoLuS
Germany1638 Posts
want to see real proof. | ||
philcorp
Canada32 Posts
On February 16 2011 05:43 motbob wrote: The sample size is plenty big enough to show a statistically significant conclusion. I'll run the relevant t-test later. It really isnt. Go and ask a full lecture hall full of first year undergraduates to go and flip a coin 100 times. By the central limit theorem you expect a gaussian distribution about a mean of 50%. If your class is big enough you will get people who flipped a coin 80 or even 100 heads in a row. Funnily enough, if you actually carry out this experiment the students will fake the data and the distribution ends up being much more sharply peaked than it should. User was warned for this post | ||
![]()
MoonBear
Straight outta Johto18973 Posts
How to replays save positioning data? It'd be really time consuming to try and load up the same map constantly. Would it be possible to data-mine replays? It may simply be the case that the algorithm for allocating spawn positions is skewed towards close positions. Since Blizzard can force no close positions on Shakuras Plateau, it stands to reason that it might be part of the map data itself. I don't know how to use the Map Editor. But perhaps someone could do some investigation to see if there are hard values encoded into the map? | ||
fiolek616
Poland2 Posts
31 reps tottal 7 close air 10 close ground 14 cross | ||
Keitzer
United States2509 Posts
or try to make a computer program that picks positions (which i think is impossible since you need blizzard's code, which is what we're questioning) | ||
BoxedLunch
United States387 Posts
edit: my results 3 cross postion 4 close ground 3 close air | ||
aristarchus
United States652 Posts
On February 16 2011 05:47 hypercube wrote: Show nested quote + On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^19 which sounds about right. The calculator at http://stattrek.com/Tables/Binomial.aspx gave me a p value of about 10^-15. (That's the probability of getting 72 or more close positions on 100 tries, and I believe it's done with precise binomial distribution calculations rather than approximations. Definitely the number should be some tiny decimal of that sort. | ||
FeyFey
Germany10114 Posts
I played random a while and got 70% terran. made a break and 2 weeks later i got 70% of the time zerg. (custom games not ladder if you want to argue bnet would set the random races, could be the start posis as well !) You should have also noticed that you get some maps alot on some days. (has other issues but randomizes plays the biggest role imo) Have a few good examples about computer randomness. Wesnoth: 70% hit chance for me 40% hit chance for the opponent. (was abusing save and load hehehe ) did about 20 save and loads until i hit more often then the opponent. Ragnarok Online: upgrading items, there was even a rumor a specific class would have better success, but that was only due to some people testing if the randomizer for the success chance was above or below normal, with cheap npc items. If it was favorable they upgraded the good stuff and made lot of profit that way. (guess the person with the comic wanted to show that, which was a good job !) anyway get down your calc and randomize it from including 1 till 4. You could end up with 70% on 1 number after 10k tryes. Dependend on how your randomizers mood is today. | ||
Seronei
Sweden991 Posts
| ||
Deadeight
United Kingdom1629 Posts
On February 16 2011 05:42 sob3k wrote: We just need to talk to the SC2GEARS dude (Dakotafanning?) and ask him if its possible to whip up a position analyzer bit in the next release. Compared to what he's already done it should be simple and once run on even one regular players replay library you should have solved the issue. If someone who was good at this stuff could make something like that it would make such a difference. We could get through a huge number of games. P.S. To people testing vs A.I., is it quicker to scout with one of your spawning workers to check or quicker to instantly surrender and load the replay? I've stuck to scouting so far (can read TL whilst it travels and stuff). | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:48 philcorp wrote: Show nested quote + On February 16 2011 05:43 motbob wrote: The sample size is plenty big enough to show a statistically significant conclusion. I'll run the relevant t-test later. It really isnt. Go and ask a full lecture hall full of first year undergraduates to go and flip a coin 100 times. By the central limit theorem you expect a gaussian distribution about a mean of 50%. If your class is big enough you will get people who flipped a coin 80 or even 100 heads in a row. Funnily enough, if you actually carry out this experiment the students will fake the data and the distribution ends up being much more sharply peaked than it should. FFS, just run any statistical test, instead of relying on your (flawed) intuition. If you took statistics in college or university you have the tools, so just use them. | ||
Chriamon
United States886 Posts
On February 16 2011 05:00 eLiE wrote: If my research class taught me anything, it's that you need a significantly high value to assume that you're getting close positions based on something other than chance. The book said 90% and up, and it's common to go as high as 95%. I'll give the book example for clarity. If you flip a coin and it lands on one side 9 times out of 10, you can assume that the coin is likely rigged. Any less, and it's more likely that the coin landed the way it did due to chance. EDIT: frozenserpent beat me to it, but a higher sample size always improves generalizability What if I flip a coin once and it lands heads, That is 100%, much higher than your 90% requirement. This arguement is rediculous of course, but it just shows that your arbitrary '90%' requirement is completely pointless. What if blizz programmed it to be 70% chance for close spawns? Thats less than 90%, but it is obviously not "due to chance" EDIT: Also, to be on topic, wouldn't there be something in the map file itself were the map actually skewed towards close spawns? perhaps someone should open the file in the map editor and check it out. | ||
Lobo2me
Norway1213 Posts
P(X=x)=(1/3)^X * (2/3)^(100-X) * (100 X) where (100 X) is the binomial coefficient. That's the chance of getting X amount of close spawn, 100-X amount of non close spawns and 100 choose X permutations. Do a sum formula for that from 72 to 100 and I got 3,213 * 10^15, which is about the same chance of happening as getting head 48 times in a row. | ||
Ihle
Norway36 Posts
On February 16 2011 05:48 philcorp wrote: Show nested quote + On February 16 2011 05:43 motbob wrote: The sample size is plenty big enough to show a statistically significant conclusion. I'll run the relevant t-test later. It really isnt. Go and ask a full lecture hall full of first year undergraduates to go and flip a coin 100 times. By the central limit theorem you expect a gaussian distribution about a mean of 50%. If your class is big enough you will get people who flipped a coin 80 or even 100 heads in a row. Funnily enough, if you actually carry out this experiment the students will fake the data and the distribution ends up being much more sharply peaked than it should. Do you really mean that you have met people who have gotten 80 or 100 heads in a row, then you are very gullible, the likelihood that this will happen is easy to calculate: 0.5^80 = 8.27*10^-25, if a friend of you did that he is one lucky guy! People suck at statistics. | ||
![]()
Zelniq
United States7166 Posts
his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. edit: someone pointed out that singleplayer games wouldn't show up in match history. true. but replays would autosave, if he wanted to prove he could post a rep pack. another person points out that if he put himself as an obs watching 2 ai's on metal then it would be very quick to see spawn locations, but then it could just be a bug with how the computer generates 2 AI spawns, not related to how players spawn | ||
space_yes
United States548 Posts
On February 16 2011 05:48 MoonBear wrote: I did a simple Binary Test on the data p00n provided. I considered the probability that close positions are more likely against the probability of close air and cross-map. Even allowing for a probability of such an event occurring as high as 0.65, your p value (0.038) would still suggest rejection of the hypothesis for a one-tail test and instead suggest that the true probability is much higher at the α=5% level. A probability of 0.7 gives a p value of 0.11 and so seems much more likely. How to replays save positioning data? It'd be really time consuming to try and load up the same map constantly. Would it be possible to data-mine replays? It may simply be the case that the algorithm for allocating spawn positions is skewed towards close positions. Since Blizzard can force no close positions on Shakuras Plateau, it stands to reason that it might be part of the map data itself. I don't know how to use the Map Editor. But perhaps someone could do some investigation to see if there are hard values encoded into the map? Yes. You could potentially check thousands of games this way. | ||
TBO
Germany1350 Posts
On February 16 2011 05:47 hypercube wrote: Show nested quote + On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^16 which sounds about right. Really shouldn't do math while learning for an linguistics exam.... been totally wrong of course. http://www.wolframalpha.com/input/?i=72 from 100 with probability 1/3 there you have it: probability to get 72 or more is 3.22x10^-15. | ||
MoreFaSho
United States1427 Posts
On February 16 2011 05:53 TBO wrote: Show nested quote + On February 16 2011 05:47 hypercube wrote: On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^16 which sounds about right. Really shouldn't do math while learning for an linguistics exam.... been totally wrong of course. http://www.wolframalpha.com/input/?i=72 from 100 with probability 1/3 there you have it Isn't that the probability of exactly 72? That doesn't seem right to me. | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:49 aristarchus wrote: Show nested quote + On February 16 2011 05:47 hypercube wrote: On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^19 which sounds about right. The calculator at http://stattrek.com/Tables/Binomial.aspx gave me a p value of about 10^-15. (That's the probability of getting 72 or more close positions on 100 tries, and I believe it's done with precise binomial distribution calculations rather than approximations. Definitely the number should be some tiny decimal of that sort. Yeah, I actually remembered the number incorrectly. Anyway, as far as I'm concerned there are only two possible conclusions: A) OP made up his numbers B) the spawn positions were not assigned with an equal and random probability | ||
Deadeight
United Kingdom1629 Posts
On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. He could've done it via single player not multiplayer custom game. | ||
![]()
MoonBear
Straight outta Johto18973 Posts
On February 16 2011 05:48 philcorp wrote: Show nested quote + On February 16 2011 05:43 motbob wrote: The sample size is plenty big enough to show a statistically significant conclusion. I'll run the relevant t-test later. It really isnt. Go and ask a full lecture hall full of first year undergraduates to go and flip a coin 100 times. By the central limit theorem you expect a gaussian distribution about a mean of 50%. If your class is big enough you will get people who flipped a coin 80 or even 100 heads in a row. Funnily enough, if you actually carry out this experiment the students will fake the data and the distribution ends up being much more sharply peaked than it should. Under a t-test, you allow for randomness due to sample size with your degrees of freedom. While 100 heads in a row is still possible, it is so unlikely that it is more feasible that the coin is simply biased or that there is something wrong with your flipping technique. If you'd like to reduce all of that to simple RNG, then here's a useful applet for you to run. http://www.math.uah.edu/stat/applets/BinomialCoinExperiment.xhtml Just for completeness (referring back to my initial Binomial test), I did a simple t-test using the sample data. I considered again the comparison of close positions against close air and cross-map as an indicator function. For H0: mean=50, my test statistic comes out to be 4.875 which is sufficient to reject the hypothesis at even α=0.0005. Also, because I am considering only a two scenario case, it is already allowing for inherent skew towards close positions. Hope that helps. | ||
philcorp
Canada32 Posts
On February 16 2011 05:52 hypercube wrote: Show nested quote + On February 16 2011 05:48 philcorp wrote: On February 16 2011 05:43 motbob wrote: The sample size is plenty big enough to show a statistically significant conclusion. I'll run the relevant t-test later. It really isnt. Go and ask a full lecture hall full of first year undergraduates to go and flip a coin 100 times. By the central limit theorem you expect a gaussian distribution about a mean of 50%. If your class is big enough you will get people who flipped a coin 80 or even 100 heads in a row. Funnily enough, if you actually carry out this experiment the students will fake the data and the distribution ends up being much more sharply peaked than it should. FFS, just run any statistical test, instead of relying on your (flawed) intuition. If you took statistics in college or university you have the tools, so just use them. All a test like the p-test will tell you is how far in the tail of the gaussian you are. Unlikely things happen, deal with it. | ||
TBO
Germany1350 Posts
On February 16 2011 05:56 MoreFaSho wrote: Show nested quote + On February 16 2011 05:53 TBO wrote: On February 16 2011 05:47 hypercube wrote: On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^16 which sounds about right. Really shouldn't do math while learning for an linguistics exam.... been totally wrong of course. http://www.wolframalpha.com/input/?i=72 from 100 with probability 1/3 there you have it Isn't that the probability of exactly 72? That doesn't seem right to me. a bit lower down there is the cumulated ones (72 or more successes) | ||
Ludwigvan
Germany2371 Posts
On February 16 2011 05:56 Deadeight wrote: Show nested quote + On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. He could've done it via single player not multiplayer custom game. Maybe in singleplayer you spawn differently than in multiplayer. | ||
KevinIX
United States2472 Posts
| ||
Playguuu
United States926 Posts
On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. Was thinking the same thing myself, with numbers just a little too outrageous. There's no reason for blizzard to do this, and random number generators are good enough to pick 12 different spawn configurations with reasonable distribution. Happy trolling. | ||
Ihle
Norway36 Posts
On February 16 2011 05:56 MoreFaSho wrote: Show nested quote + On February 16 2011 05:53 TBO wrote: On February 16 2011 05:47 hypercube wrote: On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^16 which sounds about right. Really shouldn't do math while learning for an linguistics exam.... been totally wrong of course. http://www.wolframalpha.com/input/?i=72 from 100 with probability 1/3 there you have it Isn't that the probability of exactly 72? That doesn't seem right to me. The page gives you both, but interestingly, it is more likeley to get 72 of 100 than getting 73 or more of 100, this means that the z value must be enormous. | ||
Nerski
United States1095 Posts
Chi squared equals 67.888 with 2 degrees of freedom. The two-tailed P value is less than 0.0001 By conventional criteria, this difference is considered to be extremely statistically significant So whether you arbitraly aprove of it or not, it's statistically relevant. | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:57 philcorp wrote: All a test like the p-test will tell you is how far in the tail of the gaussian you are. Unlikely things happen, deal with it. Yes, but when they do it might be worth to examine the assumptions which lead you to believe they were unlikely in the first place. | ||
gogogadgetflow
United States2583 Posts
On February 16 2011 05:56 MoreFaSho wrote: Show nested quote + On February 16 2011 05:53 TBO wrote: On February 16 2011 05:47 hypercube wrote: On February 16 2011 05:40 TBO wrote: My bad should read have read the thread more careful. However my statement is still partly true, at least if he has not been the only person doing the test. But just the only person posting it because he got this extreme results. And the results isn't too extreme btw, cumulated probability for close spots being 72 when probability for close spot being 1/3 in a sample size of 100 is 0,1066. Can you check your math? I got a z value of >8 (EV=33, SD=4,71), haven't looked up the actual probability but it must be really, really low. Someone posted 1:10^16 which sounds about right. Really shouldn't do math while learning for an linguistics exam.... been totally wrong of course. http://www.wolframalpha.com/input/?i=72 from 100 with probability 1/3 there you have it Isn't that the probability of exactly 72? That doesn't seem right to me. Yes. The probability of getting exactly 72 out of 100 with p=1/3 is 2.6*10^-15 the probability of getting 72 or more out of 100 with p=1/3 is 3.*10^-15 source: stats function on my voyage 200 | ||
hypercube
Hungary2735 Posts
On February 16 2011 05:59 Ihle wrote: The page gives you both, but interestingly, it is more likeley to get 72 of 100 than getting 73 or more of 100, this means that the z value must be enormous. You mean, it's more likely you get exactly 72 than 73 or more? Surely, that can't be right ![]() | ||
sob3k
United States7572 Posts
DID NOBODY READ THE BIG RED BANNER AT THE TOP OF THIS THREAD? Please....you guys are destroying this... if you don't have a contribution on how to solve the actual issue here then don't post. | ||
![]()
Zelniq
United States7166 Posts
On February 16 2011 05:58 Ludwigvan wrote: Show nested quote + On February 16 2011 05:56 Deadeight wrote: On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. He could've done it via single player not multiplayer custom game. Maybe in singleplayer you spawn differently than in multiplayer. it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave | ||
![]()
motbob
![]()
United States12546 Posts
However, this doesn't rule out the possibility that the OP is full of it. | ||
ReketSomething
United States6012 Posts
On February 16 2011 06:05 Zelniq wrote: Show nested quote + On February 16 2011 05:58 Ludwigvan wrote: On February 16 2011 05:56 Deadeight wrote: On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. He could've done it via single player not multiplayer custom game. Maybe in singleplayer you spawn differently than in multiplayer. it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave I also believe this is bullshit. OP should pay attention to the thread and gives feedback or replies...the fact that there isn't much of it makes it seem like he posted and is now waiting for the "chaos"... go zelniq! edit: and like motbob said...its clear if op is telling the truth this is enough to prove it T_____T i personally have never had a feeling that close positions were this common and felt that it is around 1/3 | ||
Seronei
Sweden991 Posts
On February 16 2011 06:05 Zelniq wrote: it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave You can join as spectator with 2 bots and it's much faster. It doesn't really take that much time to go through 100, shouldn't take more than 30seconds per game with this method. | ||
BeefyKnight
United States127 Posts
| ||
LoLAdriankat
United States4307 Posts
| ||
philcorp
Canada32 Posts
| ||
Duka08
3391 Posts
On February 16 2011 06:09 Seronei wrote: Show nested quote + On February 16 2011 06:05 Zelniq wrote: it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave You can join as spectator with 2 bots and it's much faster. It doesn't really take that much time to go through 100, shouldn't take more than 30seconds per game with this method. This is actually a magnificent idea, I'd be willing to do a few hundred if I found a sweet method and contribute. With replays if needed. Will post back soon I hope | ||
JoeSchmoe
Canada2058 Posts
On February 16 2011 06:05 Zelniq wrote: Show nested quote + On February 16 2011 05:58 Ludwigvan wrote: On February 16 2011 05:56 Deadeight wrote: On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. He could've done it via single player not multiplayer custom game. Maybe in singleplayer you spawn differently than in multiplayer. it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave you can use sawnoutofmemory (cheat) to disable fow to see spawn positions that way but I agree that the OP might be trolling. | ||
Deadeight
United Kingdom1629 Posts
On February 16 2011 06:05 Zelniq wrote: Show nested quote + On February 16 2011 05:58 Ludwigvan wrote: On February 16 2011 05:56 Deadeight wrote: On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. He could've done it via single player not multiplayer custom game. Maybe in singleplayer you spawn differently than in multiplayer. it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave I'm starting to agree with you. My results so far don't agree. If so it's a pretty good and unexpected troll, certainly wasted a lot of my time. | ||
![]()
Zelniq
United States7166 Posts
On February 16 2011 06:09 Seronei wrote: Show nested quote + On February 16 2011 06:05 Zelniq wrote: it's true he could have done it in singleplayer and it wouldn't show in match history apparently, it also avoids the 10 second countdown timer so it makes sense. I'm still very doubtful that he took the time to load 100 games and load 100 replays (to see spawn location, or instead wait to scout his opponent's base). I think we should assume bullshit unless he provides replays, they should autosave You can join as spectator with 2 bots and it's much faster. It doesn't really take that much time to go through 100, shouldn't take more than 30seconds per game with this method. That's true, didn't think of that good catch. However then it very well could just be something to do with how the game generates AI spawn locations and wouldn't be conclusive for player spawns, no? Shouldnt the OP have told us about that? anyway if the chance to spawn close positions was that high, after all this time and metalopolis being one of the most popular maps, people would have certainly noticed that by now. | ||
jiabung
United States720 Posts
On February 16 2011 06:03 hypercube wrote: Show nested quote + On February 16 2011 05:59 Ihle wrote: The page gives you both, but interestingly, it is more likeley to get 72 of 100 than getting 73 or more of 100, this means that the z value must be enormous. You mean, it's more likely you get exactly 72 than 73 or more? Surely, that can't be right ![]() It's right. Probability isn't logical in these extremes. The chances of something like this happening are so astronomically low that it doesn't make sense to us because we never observe it in real life. The chances of you getting 79 instead of 72 is over a million times more unlikely for instance. Also, based on personal experience I find the OP's claims pretty dubious. | ||
![]()
BisuDagger
Bisutopia19240 Posts
On February 16 2011 04:52 Dimagus wrote: The problem could be two things: - The random number generator is not as random as Blizzard thought - The algorthim to generate starting locations is flawed or it could be both. Random generators are based of the current time of your computer. No matter how complex they are made up, there is always an influence on what the outcome random number is. I will say this, random is random no matter how much coincidence you get. The result you have been given don't really prove anything. It was a fun test and interesting that your results came out so heavily in favor. But lets break this down; 2 ways you can be close by air 2 ways you can be close cross ways 2 places you are in a cross position 2 in 6 chances that you have far positions; //it is was more likely that you are not in a cross position through plain logic | ||
Annq
Germany104 Posts
On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. Matches against AI (singleplayer) arent listed in the match history? Atleast i think so | ||
Myia
173 Posts
| ||
Deadeight
United Kingdom1629 Posts
So either way 72% cannot be accurate, if it was anywhere near 72% as Zelniq said it would definitely have been noticed by now. That still doesn't it's more likely to spawn in one position, but right now I'm at basically 1/3 for all positions. | ||
Aberu
United States968 Posts
Basically the 2 positions, and different combinations in 1v1 for those positions (red at 6 oclock or blue at 6 o clock and so on). So it's not even just 2 possible combinations, it's 4 out of however many for the others. That is an important piece to put in the test. A good way to do it would be for someone to make a replay parser to test this, and us all submit replays to one person from metalopolis. | ||
Deadeight
United Kingdom1629 Posts
| ||
rS.Sinatra
Canada785 Posts
| ||
Ludwigvan
Germany2371 Posts
| ||
kzn
United States1218 Posts
I suppose we'd have to be certain the spawn choice mechanism is the same in yabot though, I have no idea how one would check that. | ||
![]()
Zelniq
United States7166 Posts
Myia, that would apply to your tests too. | ||
johlar
Sweden165 Posts
| ||
Pyrrhuloxia
United States6700 Posts
| ||
![]()
Chill
Calgary25980 Posts
| ||
Myia
173 Posts
![]() | ||
dcberkeley
Canada844 Posts
On February 16 2011 06:28 Ludwigvan wrote: I dont really know how it works, but if first the position of player 1 is created and then player 2, we have 12 possibilities and not 6. I was going to say something to this effect but it doesn't really change the probability either way. You still have 1/3 chance of spawning at the various positions. | ||
nkr
Sweden5451 Posts
On February 16 2011 06:34 Chill wrote: Please notice the giant banner at the top... Let's assume there's a possibility that it's true. How do we test it going forward? Every person in the thread does 30 games each, posts it here, and some hard working soul puts them together for a bigger sample size. Maybe. | ||
TheGrimace
United States929 Posts
-My Initial Method- So there are a few ways we can go about this. If the OP can provide 100 replays, we can confirm his results. Using sc2gears, you can see when the game was played and where both players spawned. That would likely be the quickest way to verify. -or- If people want to run another test, you can have people play 10 games and autoquit. Every replay should be within ~1 minute of each other and the game time would only be a couple of seconds each. Then those 10 replays could be sent to someone who could quickly check in sc2gears. How to check in sc2gears: 1. Open sc2gears, go to the replay analyzer and set chart type to "map view" 2. Drag and drop each replay 3. Note the spawn positions 4. Repeat The concern would be people cherry picking replays. We could have each player play a game on Incineration Zone before and after their 10 game sample. Then each submitting player would also submit their bnet profile link, and it would be very easy to take a quick look to see that only 10 games were played between the Incineration Zone games. This would mean that the 12 file created times would be sequential. I picked Incineration Zone since it's pretty unlikely anyone is playing that map normally. If we were using the Incineration Zone bookends, each player would submit 12 replays in a zip file. Any thoughts on this method? | ||
KillerDucky
United States498 Posts
On February 16 2011 06:34 Chill wrote: Please notice the giant banner at the top... Let's assume there's a possibility that it's true. How do we test it going forward? I propose the OP makes a prop bet with people in this thread. Serious suggestion. Money on the line will get things in focus quick. | ||
Logros
Netherlands9913 Posts
| ||
![]()
Chill
Calgary25980 Posts
On February 16 2011 06:40 TheGrimace wrote: I wrote this while updating my sc2gears, but once I got it loaded and checked a few replays, I realized it wouldn't work properly. Is there a MASSIVE replay pack anywhere? Like 1000+ games on Metalopolis we can feed into SC2Gears? Alternatively, is there any way to batch download from any popular replay upload sites? | ||
RoKetha
United States211 Posts
On February 16 2011 06:21 Annq wrote: Show nested quote + On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. Matches against AI (singleplayer) arent listed in the match history? Atleast i think so If you look at his map stats page, which you can clearly see includes custom games (and I think does not include ladder games), he's only played on Metalopolis 86 times, and the last time he played on it was January 10. It's hard to make sense of exactly where that data is being sampled from and if it won't count certain types of games, but at first glance it certainly looks like he didn't play 100 games there. I don't actually know where Zelniq got the account name from though (possibly a PM?) because I didn't see it myself in the thread. Edit: Sorry, I realized just moments after posting that you can play matches offline (as opposed to online vs AI) and that's what the quoted post meant. Those probably wouldn't show up. | ||
archangel967
Canada111 Posts
:D | ||
Ludwigvan
Germany2371 Posts
On February 16 2011 06:51 RoKetha wrote: Show nested quote + On February 16 2011 06:21 Annq wrote: On February 16 2011 05:53 Zelniq wrote: Has nobody even questioned whether or not the OP is telling the truth? smells like bs/trolling. can someone check his match history for 100 games on metal recently? he claims he's HUARGH (http://sc2ranks.com/eu/717496/HUARGH) on EU, division Scion Uncle http://sc2ranks.com/div/67191/division-scion-uncle his most recent match history (http://eu.battle.net/sc2/en/profile/717496/1/HUARGH/matches) doesn't show any metalopolis games. sure seems he's full of it. also I really doubt someone actually hosted a game, waited 10 seconds for it to start, scouted close positions (sent OL to close-air), or instead left and loaded replay, rinse and repeat 100 times. Matches against AI (singleplayer) arent listed in the match history? Atleast i think so If you look at his map stats page, which you can clearly see includes custom games (and I think does not include ladder games), he's only played on Metalopolis 86 times, and the last time he played on it was January 10. It's hard to make sense of exactly where that data is being sampled from and if it won't count certain types of games, but at first glance it certainly looks like he didn't play 100 games there. I don't actually know where Zelniq got the account name from though (possibly a PM?) because I didn't see it myself in the thread. He checked older posts of the OP to find out his Battle net name. Also it has already been said that he could have played single player games against the computer wicht dont appear on the match history. | ||
gerundium
Netherlands786 Posts
On February 16 2011 06:51 Chill wrote: Show nested quote + On February 16 2011 06:40 TheGrimace wrote: I wrote this while updating my sc2gears, but once I got it loaded and checked a few replays, I realized it wouldn't work properly. Is there a MASSIVE replay pack anywhere? Like 1000+ games on Metalopolis we can feed into SC2Gears? Alternatively, is there any way to batch download from any popular replay upload sites? Be wary of replay packs. people select replays to go into those, which would make the test useless (for example i'd expect more frequent cross in packs due to higher potential for epic long games). We would need to find a replay pack that is completely unbiased, plain not going to happen. which means manually loading up an x number of games in a row IS the way to go here to test it. Upload sites do not work because they suffer from the same selection bias as a replay pack. There really is no other way for this to work otherwise that i can see. | ||
![]()
Chill
Calgary25980 Posts
On February 16 2011 06:55 gerundium wrote: Show nested quote + On February 16 2011 06:51 Chill wrote: On February 16 2011 06:40 TheGrimace wrote: I wrote this while updating my sc2gears, but once I got it loaded and checked a few replays, I realized it wouldn't work properly. Is there a MASSIVE replay pack anywhere? Like 1000+ games on Metalopolis we can feed into SC2Gears? Alternatively, is there any way to batch download from any popular replay upload sites? Be wary of replay packs. people select replays to go into those, which would make the test useless (for example i'd expect more frequent cross in packs due to higher potential for epic long games). We would need to find a replay pack that is completely unbiased, which would mean manually loading up an x number of games in a row. Upload sites do not work because they suffer from the same selection bias as a replay pack. There really is no other way for this to work otherwise that i can see. Right, which is why I'm suggesting a tournament replay pack, such as the TLOpen or similar. | ||
deejY
Germany44 Posts
On February 16 2011 06:51 Chill wrote: Alternatively, is there any way to batch download from any popular replay upload sites? as close position games on meta tend to be really lame/short, and most replay sites are feeded with games that are considered worth watching, you won’t be able to conclude anything out of this | ||
gerundium
Netherlands786 Posts
On February 16 2011 06:56 Chill wrote: Show nested quote + On February 16 2011 06:55 gerundium wrote: On February 16 2011 06:51 Chill wrote: On February 16 2011 06:40 TheGrimace wrote: I wrote this while updating my sc2gears, but once I got it loaded and checked a few replays, I realized it wouldn't work properly. Is there a MASSIVE replay pack anywhere? Like 1000+ games on Metalopolis we can feed into SC2Gears? Alternatively, is there any way to batch download from any popular replay upload sites? Be wary of replay packs. people select replays to go into those, which would make the test useless (for example i'd expect more frequent cross in packs due to higher potential for epic long games). We would need to find a replay pack that is completely unbiased, which would mean manually loading up an x number of games in a row. Upload sites do not work because they suffer from the same selection bias as a replay pack. There really is no other way for this to work otherwise that i can see. Right, which is why I'm suggesting a tournament replay pack, such as the TLOpen or similar. That could work indeed, there is no bias in those. Contact the ICCup people? They are still running the MLG sundays casting all the MLG replays. that is a crazy amount of replays right there from all those events, see if they can send that set over to you? | ||
Dimagus
United States1004 Posts
There is also the issue of non-random randomness. It is not simply enough that number of occurrences satisfy a statistical variability if patterns and streaks occur. Example: repeating the pattern 123412341234... 100 times will yield a perfect 25% for each of the 4 numbers, but it isn't random. Large patterns are easy to spot but small patterns and linked numbers may not be. Assume for metalopolis 1 is 9 o'clock, 2 is 12 o'clock, 3 is 6 o'clock, 4 is 3 o'clock. 1-2 and 3-4 correspond to close spots, 1-3 and 2-4 are close air, 1-4 and 2-3 are cross positions. The problem is that if 1-2 and/or 3-4 are linked then close spots will occur more frequently. Linked means that if a 1 shows up the next number is more likely to be 2 and vice versa. 72% (33% + 39%) with a 100 game size is unacceptable, so if the mods can curb the people going "come back with 10000" since they have nothing constructive to offer. User was warned for this post | ||
Centorian
United States95 Posts
On February 16 2011 07:02 Dimagus wrote: I will state this up front since some people think it isn't true. A sample size of 100 is absolutely, positively and definitely a statistically relevant sample size for Starcraft 2. We are not talking about 100 mathematical calculations that occur within a single minute, we are talking about 100 games of starcraft 2 which occur over days and weeks. The allowable statistical variance must apply to samples as low as 100, and not just 10,000 or million. If it doesn't then there is a flaw in the algorithm. There is also the issue of non-random randomness. It is not simply enough that number of occurrences satisfy a statistical variability if patterns and streaks occur. Example: repeating the pattern 123412341234... 100 times will yield a perfect 25% for each of the 4 numbers, but it isn't random. Large patterns are easy to spot but small patterns and linked numbers may not be. Assume for metalopolis 1 is 9 o'clock, 2 is 12 o'clock, 3 is 6 o'clock, 4 is 3 o'clock. 1-2 and 3-4 correspond to close spots, 1-3 and 2-4 are close air, 1-4 and 2-3 are cross positions. The problem is that if 1-2 and/or 3-4 are linked then close spots will occur more frequently. Linked means that if a 1 shows up the next number is more likely to be 2 and vice versa. 72% (33% + 39%) with a 100 game size is unacceptable, so if the mods can curb the people going "come back with 10000" since they have nothing constructive to offer. *facepalm* we've moved on. | ||
Myia
173 Posts
Player vc Computer on Metal Close by Ground - 13 Close by Air - 19 Cross Positions - 18 Certainly more variance in the positions. But mind, this was a sample half as big as the OP's supposed size... But shows what I think, that it is indeed totally random. Perhaps the OP, if he did the test, was just very very unlucky... Edit: Just to point out, I did these all on Multiplayer, so replays are available, as are stats on whatever page you want to check them out on, if anyone is interested. | ||
gerundium
Netherlands786 Posts
On February 16 2011 07:04 Myia wrote: Ok, so, I have just done 50 (not 100 as of yet, as wondering whether I should continue after my results so far, which are little.. well, different from the OP's...) and have got the following results. Player vc Computer on Metal Close by Ground - 13 Close by Air - 19 Cross Positions - 18 Certainly more variance in the positions. But mind, this was a sample half as big as the OP's supposed size... But shows what I think, that it is indeed totally random. Perhaps the OP, if he did the test, was just very very unlucky... He could definitely have gotten the 1:10000 shot, it its at least way more likely that we are reading about a 1000 to 1 shot on here, because posting about something like this becomes more likely as someone tests this and comes up with a statistical outlier. | ||
aristarchus
United States652 Posts
On February 16 2011 06:34 Chill wrote: Please notice the giant banner at the top... Let's assume there's a possibility that it's true. How do we test it going forward? If you're worried about the difference between human and computer players and so on, I'd say you needed to use a replay pack, but it needs to be one that included all games that happened - a tournament pack would be fine - not one where someone picks out their most interesting games. sc2gears should help a lot, but I don't know of a fully automated way to do it. What's really important is that it's a single decided on test where the results will be reported no matter what they are. Saying "everyone do 10 and then report" won't work, because people could give up after 5 if they're getting boring results, etc. - no way to guarantee what you're seeing is representative of the tests people actually did. You don't need 1000 games. If the bias is anywhere near the 72% that supposedly happened in this test, 100 games is more than enough to find it. (And honestly, I'm really skeptical - if >70% of metal games were close positions, people would definitely have noticed. 70% is far enough from 1/3 to be very obvious to someone casually watching youtube videos, and definitely obvious to a pro who is carefully practicing the map.) | ||
Centorian
United States95 Posts
| ||
Myia
173 Posts
| ||
Ihle
Norway36 Posts
On February 16 2011 07:06 gerundium wrote: Show nested quote + On February 16 2011 07:04 Myia wrote: Ok, so, I have just done 50 (not 100 as of yet, as wondering whether I should continue after my results so far, which are little.. well, different from the OP's...) and have got the following results. Player vc Computer on Metal Close by Ground - 13 Close by Air - 19 Cross Positions - 18 Certainly more variance in the positions. But mind, this was a sample half as big as the OP's supposed size... But shows what I think, that it is indeed totally random. Perhaps the OP, if he did the test, was just very very unlucky... He could definitely have gotten the 1:10000 shot, it its at least way more likely that we are reading about a 1000 to 1 shot on here, because posting about something like this becomes more likely as someone tests this and comes up with a statistical outlier. It is not a statistical outlier, if everyone in the world opened metalopolis all day they would not get 72 out of 100, given the probability is 1/3. This is either a troll or a fault on the op, or it is a fault with the game. | ||
![]()
Zelniq
United States7166 Posts
On February 16 2011 06:40 TheGrimace wrote: ... How to check in sc2gears: 1. Open sc2gears, go to the replay analyzer and set chart type to "map view" 2. Drag and drop each replay 3. Note the spawn positions 4. Repeat ... I used this method and went through 50 of my metalopolis games in my autosaved replay folder (dating from Jan 13 to Jan 24th) and found 15 games where I spawned close positions. I didn't bother to tally if the others were either close by air or cross, tho I probably should have. 15 / 50 = .3, 30% of the time spawning close spots. when I have more time later I'll go through more but just putting this out there for now. I suppose you'll just have to take my word for it I forgot to check if any of these were vs the AI, but i'm pretty sure almost all or probably all were 1v1 player vs player, cus my test games vs the ai were usually on other maps, closer to the top of the map list ![]() | ||
Deadeight
United Kingdom1629 Posts
On February 16 2011 07:07 aristarchus wrote: 70% is far enough from 1/3 to be [...] definitely obvious to a pro who is carefully practicing the map. My thoughts exactly. Kind of odd that the OP hasn't been posting too. | ||
annul
United States2841 Posts
| ||
Pyrrhuloxia
United States6700 Posts
+ Show Spoiler + All tests were done as Terran vs. Random AI. Player 1 was me as orange and Player 2 was a Medium AI as blue. All tests were 1v1, Melee, Faster, and Locked Alliances. 31.25% Close Positions 10/32 43.75% (Close by) Air Positions 14/32 25% Far Positions 8/32 Player 1 Spawn Locations: 9/32 Left 9/32 Down 8/32 Right 6/32 Up Player 2 Spawn Locations: 11/32 Up 8/32 Left 10/32 Down 3/32 Right Player 2's Race (set to Random) 6/32 Zerg 13/32 Terran 13/32 Protoss Hypothesis: Randomizer is working fine. P values are as overvalued as I perceived when I was in Statistics class, and lead to all sorts of great scientific discoveries like ESP: http://www.nytimes.com/2011/01/11/science/11esp.html After 64: Close Positions: 18/64 Air Positions: 24/64 Far Positions: 24/64 Player 1 Spawn Locations 17/64 Left 13/64 Down 16/64 Right 18/64 Up Player 2 Spawn Locations 15/64 Up 12/64 Left 26/64 Down 11/64 Right Player 2's Race 16/64 Zerg 22/64 Terran 25/64 Protoss | ||
deejY
Germany44 Posts
9x cross 13x close-air 8x close | ||
Dimagus
United States1004 Posts
| ||
TheGrimace
United States929 Posts
Close: 9 Air: 9 Cross: 13 So 29% Close and Air, 42% Cross. I'll be interested to see the results of a single person performing the task in a smallish time frame. Keep it up Pyrrhuloxia. | ||
eighteen8
105 Posts
close gnd position: 37,2% close air position: 37,2% cross position: 25,6% on a total number of 45 replays for meta how about all these replay websites - there are some kind of statistics on their page (i guess these are values from uploaded replays)...maybe its also possible to do this with spawn positions. | ||
Souai
United States47 Posts
Results were: 37 Close 34 Air 29 Cross It seems the OP had a very unusual experience, used a tainted data pool, or is trolling everyone, shrug. | ||
pelicanguy
1 Post
Using an exact binomial test with p = 1/3 and number of successes = 72: P-value = 3.338*10^-15 95% confidence interval: (.62,.81) In case you don't understand what these numbers mean, there is a 3.338*10^-17 percentage chance that you will get 72 or more close position spawns or an equivalently small number of close spawns or less out of 100 games with the probability of a close spawn being 1/3. The confidence interval is an estimate of what the actual probability of spawning in close positions is, so it's about 62% to 81%. Most likely, this is just a result of pseudo-random number generators failing their job. A larger sample size will always be helpful, but from the OP's data alone you can see that the probability of a "fair" spawner is astronomically low. In fact, in order to expect to see such strange data or stranger if the probability of close spawns was actually 1/3, you would have to do about 3*10^16 trials of 100 games. That's 3000000000000000000 games of starcraft 2. | ||
Ludwigvan
Germany2371 Posts
![]() | ||
ShadowDrgn
United States2497 Posts
On February 16 2011 06:56 Chill wrote: Show nested quote + On February 16 2011 06:55 gerundium wrote: On February 16 2011 06:51 Chill wrote: On February 16 2011 06:40 TheGrimace wrote: I wrote this while updating my sc2gears, but once I got it loaded and checked a few replays, I realized it wouldn't work properly. Is there a MASSIVE replay pack anywhere? Like 1000+ games on Metalopolis we can feed into SC2Gears? Alternatively, is there any way to batch download from any popular replay upload sites? Be wary of replay packs. people select replays to go into those, which would make the test useless (for example i'd expect more frequent cross in packs due to higher potential for epic long games). We would need to find a replay pack that is completely unbiased, which would mean manually loading up an x number of games in a row. Upload sites do not work because they suffer from the same selection bias as a replay pack. There really is no other way for this to work otherwise that i can see. Right, which is why I'm suggesting a tournament replay pack, such as the TLOpen or similar. I just went through the MLG Dallas replay pack I had lying around in SC2gears: Close ground: 40 Close air: 30 Cross: 32 12.5% of having 40/102 or more in close ground spots so that's not unreasonable. Definitely nothing like the OP. | ||
Fraidnot
United States824 Posts
| ||
EcterA
United States949 Posts
Close Ground - 10 - 32.26% Close Air - 7 - 22.58% Cross - 14 - 45.16% I was going to do more, but it really is pretty boring, and it seems like a general consensus in the thread is that the OP's results might have been an anomoly, and that there is a better way to test it. I'll do more if the OP ever comes back to the discussion. | ||
| ||
![]() StarCraft 2 StarCraft: Brood War Stormgate Dota 2 League of Legends Counter-Strike Super Smash Bros Other Games Organizations
StarCraft 2 • Berry_CruncH127 StarCraft: Brood War• practicex ![]() • AfreecaTV YouTube • intothetv ![]() • Kozan • IndyKCrew ![]() • LaughNgamezSOOP • Migwel ![]() • sooper7s League of Legends Other Games |
The PondCast
WardiTV Summer Champion…
Replay Cast
LiuLi Cup
uThermal 2v2 Circuit
RSL Revival
RSL Revival
uThermal 2v2 Circuit
CSO Cup
Sparkling Tuna Cup
[ Show More ] uThermal 2v2 Circuit
Wardi Open
RotterdaM Event
RSL Revival
|
|