Puzzle algorithm change?

Sort:
Avatar of djconnel

@Martin_Stahl: whoops. I thought I was in the beta forum .
Anyway, the minimum of 5 is the problem then. Make the minimum 1 point and things will be a lot better.

Avatar of NeuralNodeSync

I deliberately deranked from over 2k to ~800 and then turned the puzzles to "Extra hard".

I'm now at ~1200 rating and consistently getting puzzles in the ~1200 range.

The fact that you have a system where you have to either have the foresight to change your difficulty setting before beginning, or otherwise deliberately de-rank *and then* change your difficulty setting, in order for the rating number to be useful, is a horrible decision.

This workaround makes the puzzle number at least makes the rating useful for yourself. However, it's still been made a completely useless metric in terms of comparison between players.

Avatar of GimliOfErebor
Rokor5 wrote:

I wrote this on another thread - this new rating system is a joke. I have been grinding for months to a year to get to 3300 rating in puzzles IN THE OLD RATING SYSTEM . I had to actually SOLVE HIGH RATED PUZZLES. now every user can get to 3300 with only solving low rated puzzles. this makes the puzzle rating completely irrelevant and stupid. puzzle leaderboard has no meaning now. change it back to the way it was!!!! this is so frustrating.

Exactly how I felt, next will be survival with 6000 lives thumbdown

Avatar of MrChatty

Today I cleared my puzzle history

Avatar of binyaminaap

Why is no one from Chess.com giving an explanation to the community and user base about this change? The idea of anyone in any rating completing an easy puzzle and earning +5 is contrary to the concept of Elo that we're accustomed to. How on earth did they even think of such an absurdity?

E.g. this guy with a puzzle rating of 65,000. Keeps getting +5 for any 3,100 rated puzzle. And it's constantly +5. Can't they even do a simple calculation to diffrentiate the gain between differrent puzzle levels?

Avatar of binyaminaap
Martin_Stahl wrote:
djconnel wrote:

I don't understand why chess-com doesn't just use the Elo system with puzzles. I believe this is what Lichess does. If you play only 1000 rated opponents, you're going to have a very tough time getting your rating much above 1400 because the points gained per success will be so low. Sure, go ahead and do that, but your rating gain will become proportional to the logarithm of time (ie increase very slowly).
Just treat puzzles as opponents and everything will work.

With the exception of the minimum+5, the site is using Glicko as far as I'm aware.

@Martin_Stahl, could you please explain the idea behind the minimum +5? Isn't this idea in itself completely contrary to Elo/Glicko systems?

Avatar of Martin_Stahl
binyaminaap wrote:

Why is no one from Chess.com giving an explanation to the community and user base about this change? The idea of anyone in any rating completing an easy puzzle and earning +5 is contrary to the concept of Elo that we're accustomed to. How on earth did they even think of such an absurdity?

E.g. this guy with a puzzle rating of 65,000. Keeps getting +5 for any 3,100 rated puzzle. And it's constantly +5. Can't they even do a simple calculation to diffrentiate the gain between differrent puzzle levels?

Puzzles give a minimum of +5 when correct, regardless of tone taken or rating.

As to the explanation, the site has re-rated all the puzzles on the backend and the puzzles are being selected and rated based on the new puzzle ratings and system. The process is in an in between stage, where the UI still shows the old ratings. That's going to be updated in the near future

Avatar of binyaminaap
Martin_Stahl wrote:
binyaminaap wrote:

Why is no one from Chess.com giving an explanation to the community and user base about this change? The idea of anyone in any rating completing an easy puzzle and earning +5 is contrary to the concept of Elo that we're accustomed to. How on earth did they even think of such an absurdity?

E.g. this guy with a puzzle rating of 65,000. Keeps getting +5 for any 3,100 rated puzzle. And it's constantly +5. Can't they even do a simple calculation to diffrentiate the gain between differrent puzzle levels?

Puzzles give a minimum of +5 when correct, regardless of tone taken or rating.

As to the explanation, the site has re-rated all the puzzles on the backend and the puzzles are being selected and rated based on the new puzzle ratings and system. The process is in an in between stage, where the UI still shows the old ratings. That's going to be updated in the near future

@Martin_StahlPlease explain the concept of assigning a minimum score of +5 for puzzles. That creates an absurd situation in which:

  1. Theoretically, the limit of a user's puzzle rating is . That could even be the case if a 65,000-rated player just solved 1,000 rated puzzles all day. He'd continue to accumulate rating points. And that's pure inflation, with no logic. Just for the sake of immediate gratification, without rewarding effort and challenge.
  2. This goes totally against the Glicko/Elo idea, which is implemented e.g. on Lichess, where each puzzle is an as if it's an opponent player, and is assigned its own Glicko. This starts with a bit of RD (rating deviation), but then as Glicko points are exchanged between the solvers and puzzles, everything gets well balanced. The puzzle automatically finds its true rating point. And so do the players.
  3. This entire approach is populist, aimed solely at gamifying and providing immediate rewards, regardless of effort and challenge. As you can clearly see - that is not what the Chess.com userbase wants. On the contrary, people are looking to improve, not be puzzle-solving mice in a cash printing machine.
    Can't Chess.com reverse this absurdity?
Avatar of GurneyHalek

It's annoying the new difficulty setting can't be changed from the mobile app. I login to chess.com just about every day from the app, and hardly ever on the desktop site.

Avatar of GurneyHalek

I don't think the old rating system was perfect, but the recent update makes the puzzle rating almost meaningless. I can solve 20+ "easy" puzzles in a row , in about 10 minutes or less, and get 100 rating points. Before the change, I used to get 3,000+ rated puzzles that would take me several minutes each to solve, and it was challenging to get above 3,000 puzzle rated. I had about 110 hours of doing puzzles on chess.com prior to the change and peaked at about 3,000 puzzle rated. Post change, I'm at 3,700 with about 10 hours of training time.

Avatar of Mtsundance
A new, to me, problem has arisen. Changed setting to extra hard on 17th. From 18th-20th there was a greater variability in puzzles provided, still too low but better. Suddenly on 21st I began to be provided puzzles all within the 1400 range more or less with my rating usually around 1700-1800. Has persisted roughly the last 80 puzzles. Not a single puzzle above low 1500s and none below roughly 1400. More challenging, that’s good,but…what gives now?
Avatar of binyaminaap
GurneyHalek wrote:

I don't think the old rating system was perfect, but the recent update makes the puzzle rating almost meaningless. I can solve 20+ "easy" puzzles in a row , in about 10 minutes or less, and get 100 rating points. Before the change, I used to get 3,000+ rated puzzles that would take me several minutes each to solve, and it was challenging to get above 3,000 puzzle rated. I had about 110 hours of doing puzzles on chess.com prior to the change and peaked at about 3,000 puzzle rated. Post change, I'm at 3,700 with about 10 hours of training time.

🎯 Exactly! Pointless (pun-intended) rating.

Avatar of sunstonexbox

I was stuck at 3100 peak rank for 1 year.

I hit 3200, 3300, 3400, and 3500 in the past 2 days.

You get 5 points per puzzle but you do lose about 20-30 points for each puzzle you get wrong.

I'm not complaining. I fly through puzzles now.

Avatar of wilflibgott
binyaminaap wrote:
Martin_Stahl wrote:
binyaminaap wrote:

Why is no one from Chess.com giving an explanation to the community and user base about this change? The idea of anyone in any rating completing an easy puzzle and earning +5 is contrary to the concept of Elo that we're accustomed to. How on earth did they even think of such an absurdity?

E.g. this guy with a puzzle rating of 65,000. Keeps getting +5 for any 3,100 rated puzzle. And it's constantly +5. Can't they even do a simple calculation to diffrentiate the gain between differrent puzzle levels?

Puzzles give a minimum of +5 when correct, regardless of tone taken or rating.

As to the explanation, the site has re-rated all the puzzles on the backend and the puzzles are being selected and rated based on the new puzzle ratings and system. The process is in an in between stage, where the UI still shows the old ratings. That's going to be updated in the near future

@Martin_StahlPlease explain the concept of assigning a minimum score of +5 for puzzles. That creates an absurd situation in which:

  1. Theoretically, the limit of a user's puzzle rating is . That could even be the case if a 65,000-rated player just solved 1,000 rated puzzles all day. He'd continue to accumulate rating points. And that's pure inflation, with no logic. Just for the sake of immediate gratification, without rewarding effort and challenge.
  2. This goes totally against the Glicko/Elo idea, which is implemented e.g. on Lichess, where each puzzle is an as if it's an opponent player, and is assigned its own Glicko. This starts with a bit of RD (rating deviation), but then as Glicko points are exchanged between the solvers and puzzles, everything gets well balanced. The puzzle automatically finds its true rating point. And so do the players.
  3. This entire approach is populist, aimed solely at gamifying and providing immediate rewards, regardless of effort and challenge. As you can clearly see - that is not what the Chess.com userbase wants. On the contrary, people are looking to improve, not be puzzle-solving mice in a cash printing machine.
    Can't Chess.com reverse this absurdity?

There are almost no people who celebrate this change. All the joy is gone.

Avatar of Martytec

This new change is ruining puzzle enjoyment for me. Wish they change back or improve the method soon.

Avatar of radical293423

The puzzle selection algorithm is somehow broken. I'm 2600+ in puzzles and the last 7 puzzles or so have all been very easy 1700 rated puzzles with high overall solving rate.

Something is not right.

Avatar of kingfisher2028

I would like a puzzle algorithm that tells me whether I am getting better at solving puzzles. But with this change it doesn't do that anymore. I set difficulty to "extra hard", now it gives me 2000 rated puzzles, I solve almost all of them and evertime I get 5 points. My score keeps going up, but not because I am getting better, but simply because I am doing more puzzles. So it doesn't serve a purpose anymore. I will stop doing puzzles on this site for now and use some of the other sites with more meaningful rating algorithms

Avatar of Inane311

I’ve been consistent on doing daily puzzles for more than a decade, clawed my way up to the 2800’s over time; and had typical ups and downs that signaled i was getting appropriately difficult puzzles. That rating is now meaningless as the puzzles no longer connect with my rating. Standard is pointlessly easy. Extra hard is still 800 points below my elo; though admittedly i missed on a few of them.

Point is though, these changes have effectively ended a game i’ve been playing continuously on a near daily basis since 2013. It’s difficult to meaningfully express the level of disappointment I have about that; but suffice to say I’m finding a new puzzle platform for general use until/unless this gets resolved; and my elo connects again with the puzzle pool.

Avatar of lonelypawnz

Agreed puzzles are ridiculously easy. Broke my puzzle streak by 17 or so. Its definitely a new change, hate it.

Avatar of Martin_Stahl
GurneyHalek wrote:

It's annoying the new difficulty setting can't be changed from the mobile app. I login to chess.com just about every day from the app, and hardly ever on the desktop site.

It's planned for the apps as well to have the settings

Avatar of Guest6593729723
Please Sign Up to comment.

If you need help, please contact our Help and Support team.