by MARCPELLETIER » Mon Jun 19, 2006 5:11 am
[quote:13081e554f]
That formula has you at a 17% chance of chance in '06...
What is this telling us?
[/quote:13081e554f]
I am not sure what you refer too.
If you refer to my overall record,
then it is telling you nothing, because you include teams for which I had no control (the Beta-testing team)
For another time, I repeat: you cannot take all-teams records, because you include leagues that can't be compared (theme leagues, keeper leagues where sometimes you will intentionally play a losing season in order to help the building effort, beta-testing teams). That is why I don't like your first line of argument, where you say that you refer to overall records.
If you rather refer to my Tour record,
then it is telling you that the sample size is still too small, but it is looking towards demonstrating that my skills enable me to get better than chance.
[quote:13081e554f]I've already argued on behalf of skill in 2005. I'm talking about 2006 only.
[/quote:13081e554f]
As far as I can see, we have the same pricing system in 2006 than in 2005, if not in the details, at least in the overall structure. Same average price for both offense and defense, more or less 0.3M. Same bullpen vs SP set-ups.
[quote:13081e554f]
This is my p value for chance in my entire 2005 season, if this thing is correct:
2-Tail : p-value = 0.000014102921916889161[/quote:13081e554f]
This means that, for 2005, you were difinitively statistically significantly better than a .500 player.
[quote:13081e554f]And since this is a zero sum game, what about the guys who play sub .500 ball over many seasons? My 2005 season reversed gives you the exact same figure, 0.00001. But as you approach .500, the p value moves to 1.00.
That is, a manager who plays .500 ball over x number of games has stats that equal pure chance. But obviously, that can't be a mathematical conclusion.[/quote:13081e554f]
The test is a 2-tail test. This means that it calculates the probability of being different than .500 from both sides. In simple terms, your 2005 season reversed gives the same exact figure, because it is similarly distant from the .500 mark. As you approach .500, you get closer to the .500 mark, up to a moment where the p value gets equal to 1. That is, a manager who plays .500 over x number of game has stats that would be exactly the same as those expected from a random sampling of flipping a coin and getting head. A player like you who plays .530 over the course of 54 seasons has a distribution that cannot be obtained from such random sampling of coin flippings.
[quote:13081e554f]AAAAAAAAAAAAAAHHHHHHHHHHHHHHHHRRRRRRRRRGGGGGGGGHHHHHHH.[/quote:13081e554f]
You complicate your life way beyond reasonable questionnings. If you have a wife, or a child, it is time to take them in your arms and feel their love.
[quote:13081e554f]All managers, all games = .500.
If we know the number of total games...
then we should be able to determine the point where a manager adds skill to a record (does the inverse hold true? negative skill?)
[/quote:13081e554f]
Exact
[quote:13081e554f]
This will be some number above .500, but it must have to be within certain parameters to define it as no longer chance (and again, I'm guessing the inverse must have to hold true).
What is that number?
How many trials are necessary?
What does that p value have to equal to determine with x amount of probability that we are no longer talking about chance??[/quote:13081e554f]
First, we must take some probability criteria. In this experiment, I think that a value of p=0.05 is restrictive enough. That is, once we get results with a probability under 5% that such results would be obtained from a random sampling of coin flipping, then we can safely conclude that skills are in action.
The number (winning success) and the number of trials necessary are not independent from each other.
For one season, I have it that a record of 101-61 is a result that is likely to suggest skill (p value under 0.05).
For two seasons, I have the same probability for a 188-136 record (so basically two 94-68 records in a row).
For three seasons, 275-211 (.566) is a highly probable sign of skill.
If I maintain my Tour record (.544), I will need seven seasons before demonstrating statistically that there is skill under work.
That being said, 5% is quite restrictive. It is the number that devils of advocate usually choose (sometimes, they even choose 1%). In fact, as soon as your probability gets under 50%, it's a sign that there is something affecting your results other than flip coins. For a season, 89-73 is the mark that crosses under 50%---there lies that +/-8 wins of random distribution. A record of 172-152 after two seasons is the mark that crosses under 50% (so after two seasons, no more than +/- 5 wins of random distributions should be expected in the data).