Extremely low rated puzzles

Sort:
Avatar of ExplosivePhrog

I am around 2850 puzzles, but consistently get puzzles below 2000. I calculated the average rating of the last 25 puzzles I got, and it was around 2050.

I also calculated the average puzzle ratings for some friends, and some were much higher despite being lower rated in puzzles than me.

Is this a bug? Does anyone else have this problem? It has been going on for a couple months now and it is really hurting my puzzles experience.

Avatar of Martin_Stahl
ExplosivePhrog wrote:

I am around 2850 puzzles, but consistently get puzzles below 2000. I calculated the average rating of the last 25 puzzles I got, and it was around 2050.

I also calculated the average puzzle ratings for some friends, and some were much higher despite being lower rated in puzzles than me.

Is this a bug? Does anyone else have this problem? It has been going on for a couple months now and it is really hurting my puzzles experience.

There have been changes to the puzzle ratings on the back end but the UI still shows the old puzzle ratings, so you can't rely on what the puzzle shows currently.

There's are also some other changes in the puzzle selection algorithm some members have.

The UI should be updated to the correct ratings in the near future and a single selection algorithm chosen as well .

Avatar of ExplosivePhrog

I mean a lot of the puzzles are definitely the rating that shows (mate in 1, free piece), and I only get +5 and -20

Avatar of Martin_Stahl
ExplosivePhrog wrote:

I mean a lot of the puzzles are definitely the rating that shows (mate in 1, free piece), and I only get +5 and -20

Some of the puzzles might have a similar rating to what's shown but many are different.

Avatar of Bar_to

Im in literally the same situation. I contacted support and they are working on fixing it, because they are making changes with puzzles. We need to stay patient for now I think

Avatar of ExplosivePhrog

Bar_to crazy that you are getting 1300 puzzles at almost 3000 lol

Avatar of Big_Drain

I'm literally in the EXACT same situation getting offered way too many stupid easy puzzles at 3300 rating

Avatar of Big_Drain
Martin_Stahl wrote:
ExplosivePhrog wrote:

I am around 2850 puzzles, but consistently get puzzles below 2000. I calculated the average rating of the last 25 puzzles I got, and it was around 2050.

I also calculated the average puzzle ratings for some friends, and some were much higher despite being lower rated in puzzles than me.

Is this a bug? Does anyone else have this problem? It has been going on for a couple months now and it is really hurting my puzzles experience.

There have been changes to the puzzle ratings on the back end but the UI still shows the old puzzle ratings, so you can't rely on what the puzzle shows currently.

There's are also some other changes in the puzzle selection algorithm some members have.

The UI should be updated to the correct ratings in the near future and a single selection algorithm chosen as well .
Any specifics ? Can you send a link ?

Avatar of ExplosivePhrog
Big_Drain wrote:

I'm literally in the EXACT same situation getting offered way too many stupid easy puzzles at 3300 rating

funny you got a 1000 puzzle

Avatar of NohJay

The more puzzles you get right, the higher the rating gets. Usually the consecutive ratings of the puzzles you do will gradually go up, by like 20 points at a time. If you get one wrong, the rating will bump back down a bit and keep working its way up. Is it possible you had a bad day with puzzles and got 5 wrong in a row, for example, and then the puzzle rating adjusts so that you can get more right?

Avatar of ExplosivePhrog

Even with a long win streak the puzzles stay the same rating. Also it shouldn't be normal to get a puzzle 1500 points lower than your puzzle rating

Avatar of Bar_to

In theory, we could exploit this system and do easy puzzles as long as they would actually become hard, but gaining fake rating is not in my nature

Avatar of ExplosivePhrog

Having these super low rated puzzles just makes it hard to improve because you never get anything challenging, and if you get one wrong you get punished with even lower rated puzzles.

Avatar of GraysonKellogg

Will this ever be fixed? I want to do puzzles again, but they're all very easy. My rating has gone up dramatically to around 2500, which I shouldn't be at, lol. No matter how much I go up, the ratings of the puzzles are almost always somewhere around 1000.

Avatar of NohJay

Puzzle rating at 800, my actual rating at 2000

Avatar of yaawu
NohJay hat geschrieben:

Puzzle rating at 800, my actual rating at 2000

For me roughly 2/10 puzzles have a rating 1k below. The only difference is those puzzles usually have pass rates of 20-35%.

Some puzzles having unreasonable ratings has been the case for ages (2048742 lol).
But since 3-4 weeks the selection algorithm is completely crazy. Some seem to get puzzles that are so easy they aren't challenging at all.
The low rated puzzles I get are on my level, I would say, but each time you fail a puzzle thats that far off you obviously lose many points. If it's the case what @Martin_Stahl is saying, that there is a discrepancy between the displayed numbers and those used in the back, the rating calculation doesn't accomodate for that. You still lose or gain the points based on the displayed ratings.

It's been like this for at least several weeks now, but still no improvements in sight.

Avatar of yaawu
Martin_Stahl hat geschrieben:

[...]

There's are also some other changes in the puzzle selection algorithm some members have.

The UI should be updated to the correct ratings in the near future and a single selection algorithm chosen as well .

And to rephrase this: What chess.com most likely currently is doing is, they run a field study on how different puzzle selection algorithms work out. So I guess they have a number of selection algorithms, and they randomly picked sample groups for each of those algorithms (e.g, "...the puzzle selection algorithm some members have"). The people getting easy puzzles all the time are possibly in one group, others, getting more difficult puzzles, in another, and so on. Who knows how many groups exist and what the differences are. And what is the goal of it? Providing fair puzzles? Or some other metric? No idea.

While I think the mentioned UI problem is likely a bug or an oversight, some members having those inbalanced selection algorithms has to be completely intentional, as it's part of chess.coms evaluation to choose "a single selection algorithm".

In the end its like @Bar_to said. "We need to stay patient for now I think." Nothing else we can do.

Avatar of justbefair
Martin_Stahl wrote:
ExplosivePhrog wrote:

I am around 2850 puzzles, but consistently get puzzles below 2000. I calculated the average rating of the last 25 puzzles I got, and it was around 2050.

I also calculated the average puzzle ratings for some friends, and some were much higher despite being lower rated in puzzles than me.

Is this a bug? Does anyone else have this problem? It has been going on for a couple months now and it is really hurting my puzzles experience.

There have been changes to the puzzle ratings on the back end but the UI still shows the old puzzle ratings, so you can't rely on what the puzzle shows currently.

There's are also some other changes in the puzzle selection algorithm some members have.

The UI should be updated to the correct ratings in the near future and a single selection algorithm chosen as well .

So you are saying that there are multiple ratings in the system for the actual puzzles?

So a puzzle rated 2600 as shown to the users may be rated only 1800 to the system?

Puzzling.

Avatar of Martin_Stahl
justbefair wrote:

So you are saying that there are multiple ratings in the system for the actual puzzles?

So a puzzle rated 2600 as shown to the users may be rated only 1800 to the system?

Puzzling.

Correct. The puzzles have basically been re-rated on the back end and those ratings are now being used for the puzzle selection algorithm and changing member's ratings. Some puzzles may have similar ratings to what's in the UI but many have changed a lot, so using the listed rating to gauge how the system is reacting isn't going to be accurate until the UI starts using the new ratings.

Avatar of yaawu
Martin_Stahl wrote:
justbefair wrote:

So you are saying that there are multiple ratings in the system for the actual puzzles?

So a puzzle rated 2600 as shown to the users may be rated only 1800 to the system?

Puzzling.

Correct. The puzzles have basically been re-rated on the back end and those ratings are now being used for the puzzle selection algorithm and changing member's ratings. Some puzzles may have similar ratings to what's in the UI but many have changed a lot, so using the listed rating to gauge how the system is reacting isn't going to be accurate until the UI starts using the new ratings.

That would be ideal, but it doesn’t align with what I’m observing - or at least, it raises some questions.

Let’s say the backend treats low-rated puzzles as being close to our actual level. Then we should see rating changes that reflect that - similar to what we’d get from puzzles at our level.

But that’s not what I see. Consistently, about two-thirds of my puzzles match my rating, while the remaining third are about 1k points lower. For that third, I always gain 5 points regardless of speed and lose significantly more than I do on the higher-rated ones.

If rating changes are calculated in the backend, as you’ve described, then the UI should reflect those updated values. So why isn’t it? And if it’s not displaying them correctly now, won’t all past rating changes eventually need to be corrected?

It all seems very odd to me.