Tactics Trainer Problem Difficulty

Sort:
Kurai

Hello!

 

Since October 24th I have noticed a change in the Tactics Trainer. Whenever I fail to do a problem, the next problem Tactic Trainer gives me is not for my rating level anymore. Solving it successfully is pointless, as I get a minimal positive rating change (+1), whereas if I fail at it, I lose many points (ca. -25).

 

Here is an excerpt from the last days (starting with 24th Oct) from my tactic trainer performance:

DateID#RatingMy RatingMovesAvg. TimeMy TimeOutcome
Oct 26, 2012 9:34 AM 0021999 2455 2784 2/4 2:06 1:47 Failed (42% | -15)
Oct 26, 2012 9:31 AM 0037964 2581 2799 1/2 0:43 0:35 Failed (42% | -12)
Oct 26, 2012 9:30 AM 0021435 2692 2811 1/5 1:06 0:08 Failed (20% | -16)
Oct 25, 2012 10:03 AM 0081018 2517 2827 0/4 1:38 1:02 Failed (0% | -27)
Oct 25, 2012 10:02 AM 0029965 2683 2854 4/4 1:50 0:52 Passed (91% | +7)
Oct 25, 2012 10:00 AM 0371733 2748 2847 2/2 0:43 0:30 Passed (86% | +7)
Oct 24, 2012 2:34 PM 0052597 2432 2840 2/2 1:10 1:10 Passed (80% | +1)
Oct 24, 2012 2:33 PM 0468573 2736 2839 0/3 1:57 0:48 Failed (0% | -21)
Oct 24, 2012 2:31 PM 0056840 2592 2860 4/4 1:37 1:09 Passed (86% | +1)
Oct 23, 2012 3:56 PM 0071317 2829 2859 7/7 7:49 7:29 Passed (81% | +9)
Oct 23, 2012 3:48 PM 0062559 2803 2850 6/6 2:12 2:05 Passed (81% | +8)
Oct 23, 2012 3:46 PM 0022849 2782 2842 2/2 1:23 0:02 Passed (100% | +13)
Oct 22, 2012 9:34 AM 0331259 2821 2829 1/5 4:01 1:22 Failed (19% | -11)
Oct 22, 2012 9:32 AM 0026185 2865 2840 0/7 3:33 1:01 Failed (0% | -15)

Notice the change between 23d Oct and 24th Oct, when suddenly the problem ratings drop, especially after a "Failed" performance.

 

Can anyone explain why the system was changed? It doesn't make much sense and punishes failure more than necessary. Is it supposed to artifically make the users' ratings drop? If so, why don't you just do -400 or -500 for every user's rating and every tactical problem and it should be fine.

 

Thank you for your answer!

 

Greetings,

Kurai

ErwinSachs

why is there no answer to this perfectly logical question??

Scottrf

Yeah it's painful when you get lower rated problems, but haven't had it happen to me recently.

They all seem to come in a row though and it's very hard to even maintain your rating.

Kurai

Hello!

 

A small update on this problem, which still exists and maybe got even worse?! Look at my recent Tactics Trainer activity:

 

DateID#RatingMy RatingMovesAvg. TimeMy TimeOutcome
Nov 20, 2012 3:00 PM 0030540 2403 2727 2/2 0:54 0:38 Passed (86% | +1)
Nov 20, 2012 2:58 PM 0225315 2749 2726 5/5 2:19 3:38 Passed (54% | +3)
Nov 20, 2012 2:52 PM 0283111 2493 2723 6/6 1:46 0:29 Passed (98% | +6)
Nov 19, 2012 9:53 AM 0111186 2407 2717 4/4 1:23 0:57 Passed (86% | +1)
Nov 19, 2012 9:52 AM 0038584 2631 2716 4/4 1:01 0:22 Passed (95% | +11)
Nov 19, 2012 9:51 AM 0040645 2468 2705 4/4 2:33 2:35 Passed (79% | +1)
Nov 18, 2012 1:33 PM 0037646 2409 2704 6/6 2:10 0:39 Passed (97% | +4)
Nov 18, 2012 1:31 PM 0040842 2696 2700 0/1 0:32 0:11 Failed (0% | -17)
Nov 18, 2012 1:31 PM 0039938 2752 2717 3/3 1:32 0:42 Passed (91% | +15)
Nov 17, 2012 11:57 AM 0023349 2501 2702 5/5 2:06 1:40 Passed (84% | +3)
Nov 17, 2012 11:55 AM 0029761 2662 2699 2/2 1:13 0:48 Passed (87% | +11)
Nov 17, 2012 11:53 AM 0044763 2726 2688 1/4 1:30 3:38 Failed (5% | -14)
Nov 15, 2012 11:16 AM 0026307 2517 2702 2/2 0:31 0:24 Passed (85% | +3)
Nov 15, 2012 11:15 AM 0101639 2529 2699 1/1 0:37 0:16 Passed (92% | +8)
Nov 15, 2012 11:15 AM 0047097 2534 2691 6/6 2:45 1:53 Passed (86% | +5)

 

 

This has been going on for a month now. As you can see, no matter how well or poorly I performed, the next problem difficulty seems to be random and rather low. And chess.com advertises with an enhanced experience for their Tactics Trainer? What's the reason for this changed behaviour of difficulty? I would appreciate an (official) answer :) Thanks!

 

Greetings,

Kurai

Josechu

Take a look here:

http://www.chess.com/tactics/problems

See how few problems there are in your (very high!) range. My guess is that TT is running out of problems to set you that are close to your rating, so they set you some that are higher and some that are lower, with the average coming out about right. 

baddogno

With all due respect Kurai, and I have nothing but admiration for your skill level and respect for the amount of work it must have taken to achieve it, you're acting as though the TT rating had some meaning.  The only purpose of the TT rating is to ensure that you are presented with a range of problems appropriate for your skill level.  Obsessing over your rating and bemoaning the unfairness of the problem selection process is just silly.  Now go enter some OTB tournaments and become the titled player that you obviously should be.

Kurai

Hello!

 

Thanks for the answers! You may be right, Josechu, that TT has run out of problems for me.

 

@baddogno: The reason why I am complaining is not my rating. The difficulty level (i.e. tactics rating) is too low for the problems presented to me! It does not matter to me which rating I have (tactic trainer rating is inflated as we all know and I stated in post #1). It is nevertheless unsatisfying to see a change of +1 after having solved a problem successfully.

 

In any case, the "problem" of lower rated (thus easy) tactics still persists, but I've gotten used to it now. Still no official response though, which I find a bit disappointing.

 

Greetings,

Kurai

Josechu

Kurai - someone told me elsewhere that beliving in moderators is like believing in Father Christmas. They don't exist. A more optimistic approach is that chess.com is like a co-operative; other members are more likely to help you out than the over-stretched staff. I quite like that, actually.

The issue you mention about only scoring +1 when you have solved successfully is more likely to be because of time than the problem rating. If you haven't looked before, from your TT home page click on <Help> and you will see a list of TT topics, including explanations of how the rating system works.

I'm going through a patch at the moment where I am getting most problems right but taking too long, so I LOSE points! (A lot of points!) 

Heler

I consulted the rating distributions of the problems and it seems that a major issue is indeed the lack of problems at very high level.

Repeating the same problems over and over again is certainly inflating the rating, as we use our memory instead of our real tactical skills. Even at my level (1700), I observe a significant repetition rate of about 5 %

And indeed, there are several players with tactical ratings well above 3000, which I suspect may be overestimated (if not, they should consider a professional career in chess Wink). At such a rating, there are only a few hundred of problems available, and the repatition rate should be near 100 % if these players are solving a lot of problems daily

Thus, I suspect that the rating range of the problems offered to highly skilled players has been broadened to avoid too many repetitions (hypothesis that could be only be confirmed or infirmed by chess.com staff).

Anyway the site should refurbish the problems library so that more challenging problems are offered to the master level.

In the meantime, I suggest that, in rated mode, the player should not be offered problems already solved (or consulted) in the past 30 or 60 days. It implies, for the program, to keep track of the activity for 1-2 month, but I think it feasible.

Martin0

Did some problems on my android. No idea why I got so low rated problems or why I was allowed to do this many tactics at the same day. Hard to maintain a rating with problems rated 1000 points below.

Mar 22, 2013 1:41 AM 0051998 1166 2037 2/2 1:01 0:21 Passed (95% | +1)
Mar 22, 2013 1:40 AM 0033508 1244 2036 3/3 1:02 0:59 Passed (81% | +1)
Mar 22, 2013 1:39 AM 0029466 1106 2035 4/4 1:49 1:01 Passed (89% | +1)
Mar 22, 2013 1:38 AM 0048779 1056 2034 4/4 0:52 0:40 Passed (85% | +1)
Mar 22, 2013 1:36 AM 0000793 1187 2033 0/3 1:47 1:12 Failed (0% | -37)
Mar 22, 2013 1:35 AM 0052316 1124 2070 3/3 1:16 0:15 Passed (100% | +1)
Mar 22, 2013 1:35 AM 0033571 1123 2069 3/3 1:57 1:21 Passed (86% | +1)
Mar 22, 2013 1:33 AM 0027811 965 2068 2/2 1:12 0:59 Passed (84% | +1)
Mar 22, 2013 1:32 AM 0000746 1057 2067 1/1 0:40 0:10 Passed (98% | +1)
Mar 22, 2013 1:32 AM 0000905 980 2066 3/3 1:09 0:45 Passed (87% | +1)
Mar 22, 2013 1:31 AM 0000766 824 2065 2/2 1:14 0:23 Passed (96% | +1)
jthomas2b

Same issue here. I had played a LOT of TT, and I believe it ran out of problems in my range.  I kept getting <1100 or >1800 rated puzzles.  One conclusive fix is to go into Settings and reset all your history  You'll start over at 1200, but move up 50+ points at a time.  And then you have the entire database to go through again.

The_Evil_Ducklings

This may be off topic, but tactics trainer seems more challengeing lately. My tactics trainer rating was always around 2600 for several years. Suddenly, I am in the 2300-2400 range for the last 300 problems. Or maybe I am just getting old :(

Sceadungen

I am having the same problem, I am not particularly concerned with the rating, the lower rated problems do have a more real world content and they are good for sharpening up.

However I am seeing an endless stream of 1400 problems many of which I have already completed 2 and sometimes 3 times.

My main reason for being on Playchess is the tactics trainer. I would be grateful if the problem could be looked at    

The_Evil_Ducklings

My are almost always original and even 2200 level problems (which used to be much easier than the 2600 variety) don't appear to be any easier. There seems to be a cap on how much I can gain (10 points) but I can lose very large amounts (30-40). About a month ago,the algorithm would repeat problems that I missed (even just a few minutes before), but that has ceased altogether. And sometimes I get a mass of composed problems, mostly endings  at a single time. Maybe the K factor was changed. I don't really care about the rating either, although I was curious as to why my rating crashed suddenly.

Martin0

I'm thinking of 2 possible effects that could harm your rating

  1. Chess.com don't want to give a problem 2000+ rating to start with, so if they added a lot of new hard problems it would especially affect those clearly above 2000 while the problems are on their way up to get their deserved rating.
  2. When your very high rated and have done a lot of problems you are starting to run out of problems at that level and will face lower rated problems. Lower rated problems (100-400 points below) is not much easier than the higher rated and the rating difference will make it a lot harder to gain rating points.

All in all you should focus on the tactics and not on your rating anyway, if your getting irritated about loosing a lot of rating points, then maybe that is part of your issue. I think your just having a bad period which everyone get sometimes. I think you'll manage to get back to that level eventually.

Sceadungen

I am not concerned about rating just variety, I am seeing a high volume of low grade problems, when I mouse slip or just screw up I drop back into a lower rating and endlessly repeat these problems.

I see no point in continuing like this, I will begin my search for another tactics training site, probably resign my membership as nobody has had the courtesy to answer this thread.

andrewmay

I agree, this has taken all the fun out of tactic trainer, which was the highlight of my chess day.

erik

sorry - what has taken the fun out of tactics trainer? i wasn't able to understand exactly what is making people enjoy it less. that they are getting problems with lower ratings?

andrewmay

Totally agree, couldn't have said it better myself.  It has been since July 24, 2013 that Tactic Trainer started acting haywire for me.  I get 25 problems, and 23-24 of them are rated 200 points lower than my rating.  So even though I'm getting 18-20 problems correct (and getting partial credit on several), I'm losing points or breaking even, all the while frustrated because the problems are 30 second puzzles...  I enjoyed it much more when I was getting difficult puzzles that would require 1-2 minutes of thinking.

erik

ok. noted. will investigate.