Puzzles on Chess.com - difficulty has changed

Sort:
Avatar of adamsdp2001

I have a free account at Chess.com and am allowed 5 puzzles/day.  My puzzle rating is ~2600 and until a week ago, was getting puzzles in the area of my rating.  However, in the last week, the puzzles being offered are all around 1600.  Does anyone know if this was a purposeful change by Chess.com or is there some way I can get back to challenging puzzles?  Thank you.

Avatar of Martin_Stahl

There's a new puzzle Difficulty setting available but it doesn't drastically change the level.

This is something I got from staff to share.

We are currently working on a significant overhaul of our puzzle difficulty system and puzzle ratings. Over time, the current puzzle rating algorithm created highly inflated puzzle ratings for our members — and consequent inaccurate estimates of a puzzle difficulty.

As we roll out our new system, you may see some inconsistencies in your puzzle stats, and rating changes from puzzles solved and missed may be greater than in the past.

We ask you to wait with us just a bit longer! Since in the coming weeks we will be publishing an entirely new rating system for puzzles for all members. We’re confident it will be a major steps towards our ultimate goals:

 - Provide a more meaningful rating which correlates more closely to player’s Blitz and Rapid ratings.

 - Serve puzzles better suited for each player’s level.

 - Offer options to member who are looking for different puzzle-solving experiences.

Avatar of TetrisFrolfChess

Sounds good, Martin_Stahl.

Avatar of adamsdp2001
Martin_Stahl wrote:

There's a new puzzle Difficulty setting available but it doesn't drastically change the level.

This is something I got from staff to share.

We are currently working on a significant overhaul of our puzzle difficulty system and puzzle ratings. Over time, the current puzzle rating algorithm created highly inflated puzzle ratings for our members — and consequent inaccurate estimates of a puzzle difficulty.

As we roll out our new system, you may see some inconsistencies in your puzzle stats, and rating changes from puzzles solved and missed may be greater than in the past.

We ask you to wait with us just a bit longer! Since in the coming weeks we will be publishing an entirely new rating system for puzzles for all members. We’re confident it will be a major steps towards our ultimate goals:

 - Provide a more meaningful rating which correlates more closely to player’s Blitz and Rapid ratings.

 - Serve puzzles better suited for each player’s level.

 - Offer options to member who are looking for different puzzle-solving experiences.

Thanks!

Avatar of KR1SHM

im doing a forum just like this but mine is about the amount of rating you lose is to much

Avatar of Martin_Stahl
KR1SHM wrote:

im doing a forum just like this but mine is about the amount of rating you lose is to much

The amount lost is due to the difference in the ratings of the puzzles and the player ratings. When all updates are in place that big difference won't be there anymore.

Avatar of KeSetoKaiba

I noticed this and suspected it was a change by the site as well, but it's good to have confirmation that this is what was going on.

Avatar of MattrickBT
KR1SHM wrote:

im doing a forum just like this but mine is about the amount of rating you lose is to much

Yeah, this has been my issue. I'm doing the best I've ever done in puzzles. I used to rarely get all 3 right in a day, now I'm getting 7-10 in a row on the regular...and my rating is not moving. 
I'll get 7 in a row for 35 pts, and then lose one puzzle and drop 28. I never dropped like this before. It's very frustrating since I'm trying to capitalize and set a new high rank and it's pretty much impossible to increase my ranking right now. And if I have a bad day where I get 2 or 3 wrong, it wipes out like 2 weeks of success.
In the past 30 days I've gotten 21 puzzles wrong and 62 puzzle correct. I started the 30 days with a rating of 2142 and today my rating is 2156. Just 5 days ago my rating was 2184. Then I got 2 straight wrong and dropped down to 2137.

Avatar of jonfrankle

Thanks, but ... as I messaged you, it's meanwhile quite annoying. My rating is going up past my previous lifetime high of around 3640, but I'm getting hardly any challenging problems. It really seems like time to wait things out until things have settled. It's really opaque (and uninteresting) to get fed gobs of puzzles in a row, all 1000 points lower rated than I am. Plus, I've been keeping records for a long while of my wins and losses vs "interesting" puzzles. I guess the ratings of these will be reset by the time this is over?
I suppose the recalibration may be worth it, but I'm tired of contributing.

Avatar of rdpxi


I totally agree with Jonfrankle. My puzzle rating is around 2500, and for the past month I've been getting puzzles down to as low as 100!! The past 2 weeks they've all been around 1400.

They are really tedious. I'm failing maybe 1in 6 so my rating is staying the same. I'm not really that bothered about the rating number, but the puzzles are extremely tedious.

Chess.com are really dropping the ball here.

I might just stop doing them and switch to Lichess.

Avatar of Manuel_Perathoner

Hey, I am having the same concern.
But did you think about the fact, that if your rating is not changing with this system, your playing strength isn't aswell, so from that point of view nothing is wrong with the current rating system? It's the same with the normal Elo: I don't know the exact numbers but let's say you have a Rating of 2000 and your opponent 1500. In that encounter you are maybe expected to score 8/10. What that implies is, if you are "totally crushing him" with 8/10, you are having your expected result and therefore your rating does not change. Of course it will change the statistic over time that you will always gain at least 5 points for each puzzle solved, because you are getting more than you mathematically deserve (in OTB Elo you can very well gain something like 1.4 Elo from a game, but maybe Chess.com has the lower limit of 5 to motivate the players. My point still stands no matter what. Maybe it is the same for your puzzles, your playing strength has not really increased since the puzzle assigning algorithm does not work well at the moment.
I haven't done it yet, but maybe try changing the puzzle difficulty in the settings, that could give you more representative puzzles again.

Avatar of chodolara

My standard puzzles were 1600 level, hard were 1900, and very hard still 1900, so overall puzzle rating goes up and up by +5, +5, +5, ... even with "very hard" setting, no more points for very hard puzzles compared to easy puzzles, all +5, time usage does not matter at all (however, maybe I would never solve any puzzle in less than 4 seconds anyway)

Avatar of Martin_Stahl

There's discussions about changing the Extra Hard algorithm some.

Avatar of yaawu

If the algorithms aren't changed consider renaming them to "trivial", "very easy", and "easy". Calling them "hard" or "extra hard" makes this whole change look even more ridiculous as it already is.

Avatar of StevetheRabbit

Thanks for the info. I have just solved 22 puzzles in a row (and counting!) and I was wondering if someone had given me a brain transplant whilst I was asleep.

No such luck, it appears!

Avatar of yaawu
Manuel_Perathoner wrote:

Hey, I am having the same concern.
But did you think about the fact, that if your rating is not changing with this system, your playing strength isn't aswell, so from that point of view nothing is wrong with the current rating system? It's the same with the normal Elo: I don't know the exact numbers but let's say you have a Rating of 2000 and your opponent 1500. In that encounter you are maybe expected to score 8/10. What that implies is, if you are "totally crushing him" with 8/10, you are having your expected result and therefore your rating does not change. Of course it will change the statistic over time that you will always gain at least 5 points for each puzzle solved, because you are getting more than you mathematically deserve (in OTB Elo you can very well gain something like 1.4 Elo from a game, but maybe Chess.com has the lower limit of 5 to motivate the players. My point still stands no matter what. Maybe it is the same for your puzzles, your playing strength has not really increased since the puzzle assigning algorithm does not work well at the moment.
I haven't done it yet, but maybe try changing the puzzle difficulty in the settings, that could give you more representative puzzles again.

In a perfect world, you are probably right. But with the recent changes you constantly have the high risk of losing a lot of rating in just one puzzle, while on the same time you are facing easy puzzles that don't give much, neither rating nor insight. As each failed puzzle now takes 5 to 8 puzzles to be equalized, this also increases the effects of things like mouse slips, technical issues, or not accurately rated puzzles.

Avatar of Martin_Stahl
yaawu wrote:

If the algorithms aren't changed consider renaming them to "trivial", "very easy", and "easy". Calling them "hard" or "extra hard" makes this whole change look even more ridiculous as it already is.

It's unlikely the names will change.

Avatar of FrostyPrusty

To solve this problem:

  • Turn off puzzle points
  • Turn on extra hard
  • Turn off coach advice

The puzzles are harder, yet you are not penalized as much for getting one wrong. In fact, you sometimes get partial credit. Perfect for the struggle.

Avatar of Martin_Stahl
FrostyPrusty wrote:

To solve this problem:

  • Turn off puzzle points
  • Turn on extra hard
  • Turn off coach advice

The puzzles are harder, yet you are not penalized as much for getting one wrong. In fact, you sometimes get partial credit. Perfect for the struggle.

The Puzzle Points feature has no impact on the puzzle selection algorithm.

Avatar of FrostyPrusty

Okay, thanks for the clarification. I just turned off extra hard to standard because I hit a plateau and needed to tun it down a bit to get my brain training right. In standard, I shot up quickly again. I thought the time I went to 2900 in one night was due to the nature of the mindset the beverage in my hand was giving me and/or there was some glitch that day, but now I'm not so sure. It's Friday so I will re-enact the "Beverage Experiment" tonight if I get a chance and see if I need to go back to extra hard mode for my puzzle fix. No matter what, though, if the puzzles are too easy, at least for me, going to extra hard mode made things a lot more challenging. I'm no chess expert, though, so maybe people are commenting on extra hard mode. It seems some are, so the new changes are possibly geared toward people like me who are here to relax and not so much for the serious players. Maybe they need an "extra extra hard" mode?