Forum


Skrumgaer on Ratings--Use Data We Already Have
skrumgaer wrote
at 5:56 PM, Wednesday February 21, 2007 EST
“I should know, my rating is 1463.� --skrumgaer

In regard to ways to encourage the top players to keep playing games, Ryan has already given us data we can use to do it. Use each player's place profile (what percent first place, what percent second place, etc.) and the number of games played. We know this for every player.

This is the way to do it. Do a goodness-of-fit test of the player’s actual profile against that which would be expected if luck, and nothing else, determined how players placed in the game. (For background, see Wikipedia on “goodness of fit�.) If luck and nothing else governed the game, the typical profile would be 14-14-14-14-14-14-14. But with skill, a player would hope to increase the numbers on the left and reduce the ones on the right.

I will use my own profile as an example. As of 6:15 p.m. on February 21, I have played 96 games and my profile is 9-11-16-22-16-14-13. The goodness of fit takes the square of the difference between my actual and expected percentage, divided by the expected percentage, summed over all games. I call this the Test Against Plain Luck (TAPL). With these numbers, my TAPL is (9-14)squared/14+(11-14)squared/14+(16-14)squared/14, ….. +(13-14)squared/14 which comes out to 8.00, which when multiplied by my games played (96) come out to 768 points.

Plain luck is not very tough to beat; even negative skill can do it. So I offer some other tests as well:

Test Against Own Worst Rating (TAOWR): instead of using 14-14-14-14-14-14-14 as the expected score, use the profile from your lowest rating.

Test Against Own Last 1500 (TAOL1500). As your rating goes up and down, you will pass 1500 periodically. Each time you are at, or close to, 1500, update the expected percentages with your current profile. This will toughen the challenge each time you do it. You can also have Test Against Own Last 1600, 1700, etc.

Test Against Known Bad Example (TAKBE). For this, use as the expected scores the profile of whoever it was who did the Phoenix Challenge. This will result in larger numbers for everyone since they are measuring their performance against pure negative skill.

The advantage of the TAPL is that for a given profile, scores increase as more games are played. Players who sit on their high TAPL’s will eventually be overtaken by those who play more games.

The TAPL is easy to set up on a spreadsheet. You can copy the number of games played and seven percentages right off the player’s profile page and use Paste Special (Unicode Text or Plain Text, but not HTML) to put it into the spreadsheet.

I have calculated the TAPL’s for the top 5 players and got the following:

NeKo839: 50 games, 30-18-18-12-14-04-04, TAPL = 1757

Hatty: 104 games, 24-15-16-22-06-06-08, TAPL = 2474

Dassault: 82 games, 24-07-18-14-18-07-09, TAPL = 1494

tzisc 129 games, 26-15-10-13-15-09-09, TAPL = 1963

kwizatz 70 games, 20-18-17-07-14-10-12, TAPL = 650

NeKo839 has a strong showing but has played only 50 games. No one seems to do better than Hatty in taking losing games and making something out of them. On the other hand, kwizatz has not learned to do so and has a lower TAPL as a result.


« First ‹ Previous Replies 11 - 11 of 11
skrumgaer wrote
at 10:48 AM, Thursday February 22, 2007 EST
To the Brain

“The majority� will agree on one thing, and others will pick something else. Select the test for the skill you are interested in measuring.

When I said “Ryan has not given us these numbers�, I meant that he had not given each of us a percentage distribution of how often we got +40, +39, +38, etc. Sorry if I did not make that clear.


To All

For your information, here are the TAPL scores for all the commenters so far. As mentioned by Coffee_Time, these are not sensitive to quality of the opposition:

Xica Da Silva, 72 games, 13-23-06-13-16-09-15, TAPL = 910

no Wolf, 12 games, 08-33-16-16-08-08-08, TAPL = 440

Coffee_Time, 132 games, 12-15-18-11-15-12-14, TAPL = 330

Grunvaggr, 149 games, 17-12-15-16-13-11-13, TAPL = 309

the brain, 37 games, 18-16-16-13-05-13-16, TAPL = 293
KDice - Multiplayer Dice War
KDice is a multiplayer strategy online game played in monthly competitions. It's like Risk. The goal is to win every territory on the map.
CREATED BY RYAN © 2006
RECOMMEND
GAMES
GPokr
Texas Holdem Poker
KDice
Online Strategy
XSketch
Online Pictionary