OK, ratings seem genuinely weird right now

Sort:
llama

But... hmm.

I haven't been tracking the active player stat, which is too bad.

It's important because there's an inflationary effect too. When a new player joins, loses 2 or 3 games, then quits the site forever deciding chess isn't for them, they've injected some points into the pool. Most new players quit... but each of them inflate the ratings very little. The few who stay and don't improve much have a negligible effect I'd say. And then those who stay and improve a lot of a big deflationary effect... but at the same time they're rare.

So overall is there inflation or deflation due to the new players? I don't know.

But the average is really simple... the average goes down when the players who are joining aren't as good as your current average. Simple tongue.png

llama
GMproposedsolutions wrote:

i say much more start, lose some and quit. just my guess, adding to the overall inflation.

whatever the mean is set at, it shouldn't change and if it does for whatever reason i say to recycle the following formula to reset distribution parameters. i bet no one is doing it and thus we have big problems in how we can relate ratings over time.


 

New rating = Old rating +(200-std dev)*(old rating - mean)/(std dev)-mean+1500

 

assuming mean is chosen to be 1500 and std dev=200 for the theoretical distribution.

The average has been going down though.

If you google old topics, you'll find it used to be about 1100, 4 or 5 years ago.
At the beginning of this year it was 990.
But recently it's dropped much faster

 

astronomer111
llama wrote:

Covid has caused a lot of new players to join. I've been looking at a few blitz stats since about May.

From May to June the total number rose from 8 to 9 million, and now it's over 10 million (active players in the last 90 days is significantly lower, at 2.6 million).

Anyway, a bunch of new players playing unrated is my guess.

Or maybe chess.com has changed the visibility of rated seeks for some reason.

So that might be why I'm up about 60-100 pts the last couple of days? I had put it down to variation in alcohol inputgrin.png

llama
GMproposedsolutions wrote:

 we have big problems in how we can relate ratings over time

True.

Sometimes I like to check Hikaru's graph. He's been, arguably, the best blitz player since the early 2000s (before chess.com existed) so his rating graph gives a good idea of what the ceiling rating was here through time... and it's gone up.

But now that I think about it, FIDE ratings inflate. I wonder if the causes are the same and why it always seems to be inflation and not deflation.

llama
GMproposedsolutions wrote:

dropped out meaning not active for 30 days+

I assume that average is counting non-active players.

llama
GMproposedsolutions wrote:

if the mean were actually falling and distribution parameters intact, then it's a problem. it means the distribution is not being followed and thus the formula for computing ratings would be wrong. it would also mean the number of standard deviations from the mean for the top players is keep increasing. makes no sense.

I've had some basic statistics, so I know what you mean (sigma and mu to define a standard distribution) but I don't know enough about applying it to real world things... obviously the graph is bell-curve-like... but how much should it match, and what does it mean when it doesn't? I don't know.

Also the rating system is indeed not correctly predicting ratings when the players are ~400 points apart. Chessbase had some article about it years ago, and some statistician suggesting some improvements.

llama

But it should only mirror if we randomly sample the population right? In reality, very bad players quit (otherwise I'm sure some ratings would be below zero, because some new players are truly that bad).

llama
GMproposedsolutions wrote:

choose the right distribution and maintain the distribution parameters. it's simple. this site won't do it and neither will the USCF nor FIDE will do it. I tired making my case with USCF 8 years ago. as far as using the gamma distribution, that's something i devised last year. this is amenable to the natural distribution that comes with varying strengths.

Hmm, ok, so in your own analysis, what are the drawbacks? Would players ratings have to be adjusted outside of games periodically to make sure there is a good fit to the distribution? That might be a reason they dislike it.