new puzzle scoring system

Sort:
Avatar of zwenna
Honor_Leslie wrote:

I have looked at other profiles and found people whose scores have not changed at all, others who have lost between 300 and 500 points, and others whose scores have dropped between 800 and 1200 points. None were reset to 400 (I haven't seen a profile like mine!) and certainly none did ridiculous puzzles with a rating below 1000-1700 in the days leading up to 9 October or afterwards. I, on the other hand, have been unfairly robbed of almost 31,000 points, and even though I have the settings on extra hard, all the puzzles are mate in 1 and do not exceed a rating of 700 or so. 

This should not have happened, and I would recommend that you contact support. Maybe they can manually adjust your puzzle rating, or give you premium for a few days so you can fix it by solving some 200 puzzles.

Avatar of Avandhar
Honor_Leslie wrote

I have looked at other profiles and found people whose scores have not changed at all, others who have lost between 300 and 500 points, and others whose scores have dropped between 800 and 1200 points. None were reset to 400 (I haven't seen a profile like mine!) and certainly none did ridiculous puzzles with a rating below 1000-1700 in the days leading up to 9 October or afterwards. I, on the other hand, have been unfairly robbed of almost 31,000 points, and even though I have the settings on extra hard, all the puzzles are mate in 1 and do not exceed a rating of 700 or so. 

There was something really strange with your puzzles even before the change. You had a rating around 3500, yet the system kept giving you puzzles rated only about 400. As far as I understand, the puzzle difficulty should also increase as your rating increases. Hardly your fault though. So you were solving easy puzzles the whole time, and because of the old +5 minimum gain rule, every correct answer still gave points. That’s how the rating just kept inflating.

After the rerun with the new (more ELO like) formula, those artificial +5s disappeared. In Elo terms, if someone solves 400-rated puzzles with an 85% success rate (as you had), their real equilibrium rating (unless I ran the numbers wrong) would be around 700. Your new rating of 638 is actually quite close to that figure. and the difference can easily be explained by lets say that the average strength of the puzzles was bit lower than 400. So the logic seems right.

The strange thing to me is why you were given only easy puzzles making it essentially impossible for you to increase your rating. The system did not serve you well here and I can see why it would seem unfair.

Avatar of Martin_Stahl
Avandhar wrote:

There was something really strange with your puzzles even before the change. You had a rating around 3500, yet the system kept giving you puzzles rated only about 400. As far as I understand, the puzzle difficulty should also increase as your rating increases. Hardly your fault though. So you were solving easy puzzles the whole time, and because of the old +5 minimum gain rule, every correct answer still gave points. That’s how the rating just kept inflating.

After the rerun with the new (more ELO like) formula, those artificial +5s disappeared. In Elo terms, if someone solves 400-rated puzzles with an 85% success rate (as you had), their real equilibrium rating (unless I ran the numbers wrong) would be around 700. Your new rating of 638 is actually quite close to that figure. and the difference can easily be explained by lets say that the average strength of the puzzles was bit lower than 400. So the logic seems right.

The strange thing to me is why you were given only easy puzzles making it essentially impossible for you to increase your rating. The system did not serve you well here and I can see why it would seem unfair.

The puzzle selection algorithm, even before the rating update last week, was using the same process as it has been for the past few months, ever since the Difficulty setting was first implemented.

If someone was getting 400 then their rating history had been reset. If they were also on Standard difficulty, they would get low rated puzzles for a while, until the rating increased sufficiently.

Avatar of Pastafreez
It was good
Avatar of zwenna
Martin_Stahl wrote:

If someone was getting 400 then their rating history had been reset. If they were also on Standard difficulty, they would get low rated puzzles for a while, until the rating increased sufficiently.

My rating history does not look like it had been reset, yet I was getting not easy but trivial puzzles and even after choosing Extra Hard difficulty, the puzzles were so easy that I had a success streak of 140 puzzles until they became sufficiently difficult.

And @Honor_Leslie has a maximum rating of 3558 according to the new rating system, but on September 29 apparently crashed to 400, also without this being visible in the history graph.

Avatar of Martin_Stahl
zwenna wrote:

My rating history does not look like it had been reset, yet I was getting not easy but trivial puzzles and even after choosing Extra Hard difficulty, the puzzles were so easy that I had a success streak of 140 puzzles until they became sufficiently difficult.

And @Honor_Leslie has a maximum rating of 3558 according to the new rating system, but on September 29 apparently crashed to 400, also without this being visible in the history graph.

You're getting puzzles close to your rating. Since the rating change, you've done 30 puzzles and your success rate is pretty high, so your current ability appears to be higher than your current rating,

As to @Honor_Leslie, the graph not being updated is due to how the rating was changed, before the system updates. If you look at the puzzle archive it was reset prior to the updates. For answer to why, they'll need to contact Support directly.

Avatar of Maurius45
Wait thats not a bug
What
Avatar of Maurius45
Well what is a bug is that I get 600 elo puzzles
Avatar of Martin_Stahl
Maurius45 wrote:
Well what is a bug is that I get 600 elo puzzles

No. Players at the lower levels could have increased in rating. All the puzzles were rerated and a lot of lower rated puzzles went up. So, when a member's puzzle history was reran through the algorithm with those new ratings, there was the potential for a rating increase, especially among members that had a lot of puzzles that increased in rating.

Avatar of jrl18
This new system sucks enough to not renew the subscription.
Avatar of ChessPhD_in_AppStore

If you want to seriously improve your tactics vision, check out my app in AppStore:

Chess.PhD: Puzzles & Tactics

It has over 5M+ puzzles, adaptive difficulty, detailed stats, refutation mode, engine and streak challenges to keep you sharp. And of course it has right ELO system happy.png 
Perfect for daily training — just install and start solving.
And it's free wink.png Here is the link

Avatar of beanthere

My rating dropped about 400 points when they made this change, but part of me thinks: so what?

It's just an arbitrary rating anyways, so who cares.

Avatar of Batdad1969

I would like to understand how the new rating system works ...

I failed a puzzle - and when I looked back at my puzzles for the day I saw this list.

So ... I thought the puzzle I got wrong (highlighted above) is a puzzle rated 1983. I went into the puzzle - and this is the puzzle I failed.

Now correct me if I am wrong - but hat looks to me like a puzzle with a rating of 2266 (bottom right corner)

Avatar of Martin_Stahl
Batdad1969 wrote:

I would like to understand how the new rating system works ...

I failed a puzzle - and when I looked back at my puzzles for the day I saw this list.

So ... I thought the puzzle I got wrong (highlighted above) is a puzzle rated 1983. I went into the puzzle - and this is the puzzle I failed.

Now correct me if I am wrong - but hat looks to me like a puzzle with a rating of 2266 (bottom right corner)

That 2266 is the old puzzle rating. Staff are aware of that needing updated in that section and she should be fixed and an upcoming version of the app.

Avatar of ryanhellyer

I'm really enjoying the new puzzle system. It feels like it's a challenge to increase in rating now, whereas before it felt like if I just did more puzzles, my rating would very slowly increase over time, but with the new system, it feels like I'll eventually settle in at my correct level. The upward movement is now extremely slow. Hopefully it will eventually settle in at my correct rating; fingers crossed that's somewhere over 2000 happy.png

Avatar of KrazKnight
The new puzzle scoring is quite demoralizing. I understand the downward adjustment, but now scores for correct puzzles are 2 pts and incorrect ones are -15 pts. For me, this just equates to a downward spiral in my score which takes away the gratification. I am an intermediate player at best and I think the rates were inflated somewhat, but now it is just crap.
Avatar of Martin_Stahl
KrazKnight wrote:
The new puzzle scoring is quite demoralizing. I understand the downward adjustment, but now scores for correct puzzles are 2 pts and incorrect ones are -15 pts. For me, this just equates to a downward spiral in my score which takes away the gratification. I am an intermediate player at best and I think the rates were inflated somewhat, but now it is just crap.

How much you gain or lose depends on the difference between your puzzle rating and the puzzle's rating. On Standard difficulty the average rating of puzzles is lower than your rating and you'll get fewer points on success and lose more on a failure.

You might try Hard or Extra Hard where the point balance is different, though you'll likely dolce fewer puzzles and the overall rating changes will be similar.

Avatar of Deckard_R
I actually think the new system makes much more sense than before. And ratings too.
Avatar of cailleach

I love that time is impacting the rating changes to a lesser degree now ❤️. I'm perfectly fine with having been stripped of about 1100 rating points, down to 2200 now, seems more reasonable when compared to actual ELO, probably still too high. On Standard difficulty, the rating change is quite demotivating (many solved puzzles necessary to balance a failed one), but on Extra Hard it's about 1:1 or even slightly better, so that seems the best mode for me. It's a relief to have a working puzzle system back, after months of ridiculous behaviours.