Hopefully this translation from Croatian to English is reasonable:
And this article says that comparing players Elo system a priori associated with errors due to inflation points in the system over time. Somewhere I read, I think that because of the necessary corrections such as Fischer was roughly ranked with Kasparov. As far as the comparison criterion which gives the best moves a chess program, there was new information to third Rybka Here's a link to chess.com:
Methods for comparing top chess players throughout history
This article examines a number of methodologies that have been suggested for the task of comparing top chess players throughout history, particularly the question of comparing the greatest players of different eras. Statistical methods offer objectivity but, whilst there is agreement on systems to rate the strengths of current players, there is disagreement and controversy on whether such techniques can be applied to players from different generations who never competed against each other.
Elo System
Perhaps the best-known statistical model is that devised by Arpad Elo. In his 1978 book The Rating of Chessplayers, Past and Present, he gave ratings to players corresponding to their performance over the best five-year span of their career. According to this system the highest ratings achieved were:
(Though published in 1978, Elo's list did not include five-year averages for Bobb Fischer and Anatoly Karpov. It did list January 1978 ratings of 2780 for Fischer and 2725 for Karpov.)
In 1970, FIDE adopted Elo's system for rating current players, so one way to compare players of different eras is to compare their Elo ratings. The best-ever Elo ratings are tabulated below.
The average Elo rating of top players has risen over time. For instance, the average of the top 100 active player rose from 2644 in July 2000 to 2697 in March 2011, a 53-point increase. Many people believe that this rise is mostly due to a system artifact known as ratings inflation, making it impractical to compare players of different eras.
Arpad Elo was of the opinion that it was futile to attempt to use ratings to compare players from different eras; in his view, they could only possibly measure the strength of a player as compared to his or her contemporaries. He also stated that the process of rating players was in any case rather approximate; he compared it to "the measurement of the position of a cork bobbing up and down on the surface of agitated water with a yard stick tied to a rope and which is swaying in the wind".
Chessmetrics
Many statisticians since Elo have devised similar methods to retrospectively rate players. Jeff Sonas, for example, calls his system Chessmetrics. This system takes account of many games played after the publication of Elo's book, and claims to take account of the rating inflation that the Elo system has apparently suffered.
One caveat is that a Chessmetrics rating takes into account the frequency of play. According to Sonas, "As soon as you go a month without playing, your Chessmetrics rating will start to drop". While it may be in the best interest of the fans for chess-players to remain active, it is not clear why a person's rating, which reflects his/her skill at chess, should drop if the player is inactive for a period of time.
Sonas, like Elo, acknowledges that it is useless to try to compare the strength of players from different eras. In his explanation of the Chessmetrics system,he says:
Nevertheless Sonas' Web site does compare players from different eras, and shows that in such cases the Chessmetrics system is rather sensitive to the length of the periods being compared. Including data until December 2004, the rankings were:
In a 2005 ChessBase article, Sonas uses Chessmetrics to evaluate historical annual performance ratings and comes to the conclusion that Kasparov was dominant for the most number of years, followed closely by Lasker and Karpov.
Warriors of the Mind
In contrast to Elo and Sonas's systems, Raymond Keene and Nathan Divinsky's book Warriors of the Mind attempts to establish a rating system claiming to compare directly the strength of players active in different eras, and so determine the strongest player of all time. Considering games played between sixty-four of the strongest players in history, they come up with the following top ten:
These "Divinsky numbers" are not on the same scale as Elo ratings (the last person on the list, Johannes Zukertort, has a Divinsky number of 873, which would be a beginner-level Elo rating). Keene and Divinsky's system has met with limited acceptance, and Warriors of the Mind has also been criticised for its arbitrary selection process and bias towards modern players.
Actual moves played compared with computer choices
A computer-based method of analyzing chess abilities across history came from Matej Guid and Ivan Bratko from the Department of Computer and Information Science of University of Ljubljana, Slovenia, in 2006. The basis for their evaluation was the difference between the position values resulting from the moves played by the human chess player and the moves chosen as best by a chess program, Crafty. They also compared the average number of errors in the player's game. Opening moves were excluded, in an attempt to negate the progress in chess opening theory. According to their analysis, the leader was José Raúl Capablanca, followed closely by Vladimir Kramnik.
The "Classical" World Chess Championship matches were analyzed, and the results for the fourteen Classical World Champions were presented.
Players with fewest average errors:
The method received a number of criticisms, including: the study used a modified version of Crafty rather than the standard version; even the standard version of Crafty was not strong enough to evaluate the world champions' play; one of the modifications restricted the search depth to 12 half-moves, which is often insufficient. As of 2006 Crafty's Elo rating was 2657, below many historical top human players and several other computer programs.
A similar project was also conducted in 2007 using Rybka 2.3.2a and a modified version of Crafty 20.14.
Analysis by Rybka 3 and comparisons with modern ratings