Right. Incredibly common is play the first 4 moves of a mate in 5 and then hang a piece. A real human would have never played the first 4 moves unless he saw the 5th move.
A Turing test for chess engines
Sort:
Mar 14, 2016
0
#23
EscherehcsE wrote:
One trick that's available - You can also get an even older version of Delfi from the Wayback Machine. It's Delfi 4.6, which was before it went commercial. You can set it from 1250 to 1700 elo, but it's a Winboard-only engine. (Also, I'm not sure how accurate the elo settings are for this version.)
https://web.archive.org/web/20060506112927/http://www.msbsoftware.it/delfi/
In case anyone is interested in Delfi 4.6 via the Wayback Machine: I did a little testing, and Delfi 4.6 seems to be about 200 elo points stronger than the current Delfi 5.4. That is, with Delfi 4.6 set at its lowest level of 1250 elo in the free version, that's roughly equal to Delfi 5.4 set at 1450 elo.
Mar 16, 2016
0
#24
I played an engine-engine match of 10 games between Hiarcs 13.2 and Delfi Trainer 5.4 at a novice level. Delfi was set at 1300 elo. Although Hiarcs was set at its lowest setting of 750 elo, it played Delfi about even. (I DID say that Hiarcs 13.2 plays stronger than its rating at the lowest end. I don't know if they fixed this problem for Hiarcs 14.)
Time control for all games was 40 moves in 20 minutes (an average of about 30 seconds per move). I disabled the opening books for both engines; Delfi would occasionally play a bit of a squirrelly move in the opening, but if you use its opening book, there shouldn't be a problem.
Here's Game 1:
Mar 16, 2016
0
#34
One tip about using Hiarcs 13.2 at its lowest setting: If this setting is still too strong for you, your GUI (Graphical User Interface) might allow you to also reduce the CPU time from 100% down to as low as 1%, which will further weaken Hiarcs. (I know that Arena and the Shredder GUI have this option.) As a test, I reduced the Hiarcs CPU time down to 6%, and it reduced Hiarcs' strength probably 200 or more rating points. (Delfi Trainer 5.4 elo 1300 beat it 10 games to nothing.) The only disadvantage of using this option is that Hiarcs moves much faster than the allowed time control.
<snip> In my experience with any system involving a strong chess engine with adjustable levels the resulting play usually involved the computer making two or three powerful moves, countering my most subtle threats and exposing weaknesses in my own position I didn't know existe, followed by an unbelievably stupid blunder. <snip>
I'm familiar with that complaint; I've heard it probably a hundred times or more over the years. It's usually true...