Average score is changing in Puzzle Rush

Sort:
Avatar of HowFaresTheKing

For some reason my average Puzzle Rush score after over 1,100 games was 12.97 this morning. I only played twice today and now my average now shows as 12.26.

Something seems to be amiss. Hmmm...

Avatar of MainframeSupertasker

It's probably limited to the average of past 15 rushes or so.

Avatar of MainframeSupertasker

Think if the player was bad at puzzle rush when he started it, and he played a lot of it, and now he regrets having that bad average score. This new average is way better happy.png

Pretty much accurate also.

Avatar of Elroch

Something seems to have been changed yesterday, and I can't work out exactly what the change was. I had an average of 21.47 and after one game with score 21, it was 21.00. Another run with 22 left it at exactly 21.00.  Then a later run with a relatively bad 16 only dropped it to 20.98.

This can be explained by a shift from a short term average to a longer term average yesterday. The new version could be

  1. a simple average of all scores
  2. a simple moving average with a time constant of around 160-250
  3. an exponential moving average with a time constant of around 320-500

I think it is probably number 1 or 3.

Avatar of Hedgehog1963

I would have sworn that they made it harder suddenly then just now i equalled my all-time best score.  only 17 but I've achieved it once before in 360+ attempts.

Avatar of erik

We are now doing your average over your last 10 attempts. 

Avatar of MainframeSupertasker

That makes sense

Avatar of Elroch

@erikan average of 10 runs does not explain any of the numbers I saw yesterday. For example,. my last score was 16 (worst in the last 25), but it only moved the average down by 0.02. If it was a simple average of 10 runs, there would never be a second decimal digit.

Just done another run and found a 22 raised my average from 20.98 to 20.99, which is consistent with an average of a large number of runs but not with an average of 10 runs.  Please could you clarify what average is actually being used?

 

I stick to my conclusion that a fairly long exponential moving average (EMA) is the best choice because of both averaging a decent amount of data and responding in a very well-behaved way to new data (the change is always proportional to the difference between the score and the previous average). Based on the empirical data, I don't believe an EMA is being used at present.

Avatar of Varego

MainframeSupertasker and my averages fits with last 16 attempts. But did not fit with OPs average. Did the calculations 6-7 hours ago.

Avatar of Elroch

Mine is not consistent with any short average including 16.

Avatar of Varego

I know.. did only fit for me and Mainframe, it must have been a coincidence.

Avatar of Elroch

Changes as small as 0.01 (like mine today) are only consistent with simple averages with period over 50.

Avatar of LTwo
erik wrote:

We are now doing your average over your last 10 attempts. 

Oh... that explains my recent drop in points...

Avatar of LTwo

Is this for only beta or no?

Avatar of LTwo

Also, I have a suggestion: You should make an option to see your all-time Puzzle Rush average too.

Avatar of Elroch
LewisTu wrote:
erik wrote:

We are now doing your average over your last 10 attempts. 

Oh... that explains my recent drop in points...

Sort of, but it's not a 10 game average. It will be interesting to hear what it actually is.

Ah! I bet it was a typo, and erik meant 100 games.

Avatar of HowFaresTheKing

"We are now doing your average over your last 10 attempts."

That makes sense. I was playing while watching TV and unsurprisingly my average went down. lol 

It would be great if chess.com can add a graph showing how the a player's rolling average score is changing over time. It would be nice to have visual reinforcement for working to improve it.

 

Avatar of Elroch

Yeah. It's really like a rating, or should be. For a one player game.

Avatar of MainframeSupertasker
HowFaresTheKing wrote:

"We are now doing your average over your last 10 attempts."

That makes sense. I was playing while watching TV and unsurprisingly my average went down. lol 

It would be great if chess.com can add a graph showing how the a player's rolling average score is changing over time. It would be nice to have visual reinforcement for working to improve it.

 

Ahh yes! absolutely.. i guess ... that Rated Puzzle Rush thing that is in development will have it.... i guess ... 

Avatar of HowFaresTheKing

@erik "We are now doing your average over your last 10 attempts."

 

That would be great, but it is not how it is working correctly at the moment. 

My Puzzle rush average in showing in my profile is 12.28 and the average of my last 10 games is 13.4. 

Thank you for working to improve the website!