Q & A With Dan Heisman featuring NM Dan Heisman is OPEN to ALL MEMBERS! Click here to watch!
Upgrade to Chess.com Premium!

How engines have changed opening theory


  • 14 months ago · Quote · #1

    nameno1had

    I was curious if anyone had any good insight into how improving engines have maybe caused there to be changes to opening book theory.

    It would stand to reason that as the ability of engines to see more deeply into move combinations, that either different openings would have been solved or perhaps a variation once thought to be not as strong as another, may have been proved to actually be better. I welcome any comments or opinions on this subject, as I know next to nothing about it.

  • 14 months ago · Quote · #2

    Sleight

    So engines are interesting in relation to the opening.  In fact, engines are useful to watch out for traps and tactics but are not considered up to snuff compared to a veteran GM.  In engine vs. engine tournaments, their opening books are chosen in collaboration with Grandmasters who work a lot on opening theory because engines can't "see" well into strategic ideas until the position is quite established.

     

    If you picked out a random Benoni line with an even-ish evaluation by GMs, you'd often find most engines will evaluate it as strongly in White's favor for as many as the first dozen moves, sometimes more.  Engines often also like doing things like trading off the Dragon Bishop in the Sicilian Dragon for the sake of a pawn, though this idea typically is terrible strategically.

  • 14 months ago · Quote · #3

    hicetnunc

    They had a tremendous impact on professional chess : most novelties these days are computer-generated. All of them are computer-checked.

  • 14 months ago · Quote · #4

    uhohspaghettio

    Sleight wrote:

    So engines are interesting in relation to the opening.  In fact, engines are useful to watch out for traps and tactics but are not considered up to snuff compared to a veteran GM.  In engine vs. engine tournaments, their opening books are chosen in collaboration with Grandmasters who work a lot on opening theory because engines can't "see" well into strategic ideas until the position is quite established.

    Their opening books would be chosen in advance whether they used GM input or not. The GMs use the computers heavily in their analysis. Sometimes the GMs can improve on them. However these situations are becoming less and less often. 

    At one point, it was debatable whether or not computers would ever beat humans in chess. There was some credible computer expert that placed a bet that no computer would ever beat a master in any game by the year 2000. With the approaching limits of conventional electronics nearing their peak, there was a reasonable claim out their that perhaps computers would never be able to play very well at chess, owing to their horizon limit. For better or worse, they were wrong. 

    Sleight wrote:

    If you picked out a random Benoni line with an even-ish evaluation by GMs, you'd often find most engines will evaluate it as strongly in White's favor for as many as the first dozen moves, sometimes more.  Engines often also like doing things like trading off the Dragon Bishop in the Sicilian Dragon for the sake of a pawn, though this idea typically is terrible strategically.

    How sure are you on this? We're talking about world class supercomputers with hundreds of cores and terrabytes of RAM spending hours going through variations, not your home computer with a few ghz and a few gbs RAM spending one minute.  

    Frankly my guess is that nowadays they are more about organizing the whole technical aspect of it, like deciding what variations to go down and how long/what resources to spend on them and what eventual route to take with the computer's strengths in mind (distinguishing or choosing between computer-friendly positions for purposes of computer pruning is hardly the same as theoretical openings in chess).... and basically organizing and holding the whole thing together... rather than theroetical opening supremacy.  

    I guess it's possible that the expert theoretical GMs brooding for hours and hours over problems still have a card or two up their sleeves for some variations, but as time goes on and on it will be less and less. And they know that in a lot of positions, they have no chance of doing better than the computer. Super GMs have practically no interest or reason for developing their own theroetical novelties (objectively best, psychologically playing something is obviously different), it would take way too much time. It was very different back years ago.

    It's not just me saying this, in the world of professional chess there has been a lot of open mourning and grieving over the dying of the fine art of opening theory in chess. 

    People are forgetting what it was like. People are forgetting about the debates and the passion people had and their convictions about openings. Like the people who swear to the death by the Dragon, or by the Advance French, or by the Najdorf. And for every answer you gave they'd have another trick/move up their sleeve, some might even be preposterous like 1. b4.  

    And people would look to the experts in openings for their suggestions. Even the super gms would look to these specialized openings experts. And the super gms would be expected to come up with theoretical novelties of their own. Now it's all over. Computers come up with the theoretical novelties.

  • 13 months ago · Quote · #5

    nameno1had

    The reason I brought this up is because, I have wondered if maybe there are a few openings that have moves that were maybe on the bubble , as far as being better than others.

    I thought maybe the best GM's and thus programmers, chose particular moves over others because, it was easier to exploit certains lines over others, and with the advent of better programs such as houdini, certain lines that were typically pruned before were perhaps clarified.

    I realize that this,in and of itself, most likely wouldn't change the opening anywhere near as much as the middle game, but considering my head starts to spin when trying to imagine, have programmers crunched every variation, for every opening? My first guess is yes, but I can see where they have probably spent far more time on the main stays of chess, with lessor machines and programs.

    One reason I inquire about this, other than wanting to know if computers have reproved GM's  prior theories is, I used to have a Kasparov program for a cell phone. If I tried any king or queen pawn opening on the hardest level, I almost always lost, but if I played certain other openings, I could actually win or in one case with a variation of the English, I could wipe the floor with it. I realize the English has been well explored by computers, but I don't know where to find the latest theory news or ideas for more obscure openings.

  • 13 months ago · Quote · #6

    nameno1had

    I noticed no one has seemed to delve into this idea too much lately. I had an idea I thought would stir things up. I have a Chessmaster program I have been using for some experiments.I realize it isn't the cutting edge in engines, but I found you can still do some interesting experiments that, probably are still rather accurate in overall assessment. I was curious as to what it would assess as the best opening for white to play, giving it the best chance to win versus all of the other possible openings. This idea is probably far less calculable without engines.

    So I set up the program to play itself in the infinite mode. After a few hours no first move. So I click the force option. Once the first move was selected, it quickly realed off a succession of moves. That tells me it has the ability to weigh its chances with each opening. It just takes forever to calculate the possibilities.

    I used the take back move feature to clear all of the moves, to set this game scenario up again. I was curious as to whether it would quickly put the same moves back it had previously selected. I was curious if it was still able to calculate the line from the point it had left off at, or if it needed to start over. I noticed an interesting phenomenon, it did start the calculation process over. It selected the King's Indian after the initial force, but after the take back, it chose 1. e4.

    I let each of these play until mate. White won soundly with the King's Indian, but lost a close King's Pawn Game. I have wondered if Houdini or Rybka gets similar results. If this is accurate, we could use this to make a list of openings in which white can't be beaten if the strongest moves are played. I realize it would be a daunting task to check all of the possible variations to make sure this theory holds true, due to the propensity of engines seemingly miscalculate.

    I am curious as to anyone else's ideas or experiments as it pertains to this ideology. For example has anyone set up their newer engine to play itself without a timer to see what opening it chooses and how quickly?

    The reason is, I wonder if programmers just put in a program randomizer(using a finite set of predetermined relevant moves), for the computer to pick opening moves and defenses. I suspect this is also possible because of Chessmaster's multiple reactions with black, to the same opening move on multiple occasions.

    Please, I implore you, let us reason together. Johnny 5 needs input...

  • 13 months ago · Quote · #7

    uhohspaghettio

    nameno1had, I see you've put a lot of effort into your post, but you should know that your suggestion that because chessmaster beat itself using the king's indian and drew with the king's pawn opening must mean that the king's indian is superior is absololute nonsense.

    "we should try to make a list of openings where white can't be beaten when the strongest moves are made"....

    good joke...   

  • 13 months ago · Quote · #8

    Vease

    Some openings that were hardly played years ago are popular or at least not uncommon now. The Scandinavian was regarded as unsound until Anand unleashed it against Kasparov in 2000..guess where he got his ideas from? The Rubinstein/Burn variation of the French Defence was hardly ever played at the top level until recently, purely because of new ideas found by computer analysis.

    Tactical minefields like the Botvinnik and Moscow variations in the Semi-Slav are perfect for computer analysis so thats why the Slav is now much more common than the Orthodox defence to the Queens Gambit. The Najdorf and Dragon Sicilians also lend themselves to a brute force calculating approach. What is interesting is how someone like Morozevich has resurrected the Budapest Gambit, The Albin Counter Gambit and the Chigorin Defence in the Queens Gambit based entirely on computer aided analysis, that is the good side of using a chess engine to find novelties.

  • 13 months ago · Quote · #9

    nameno1had

    uhohspaghettio wrote:

    nameno1had, I see you've put a lot of effort into your post, but you should know that your suggestion that because chessmaster beat itself using the king's indian and drew with the king's pawn opening must mean that the king's indian is superior is absololute nonsense.

    "we should try to make a list of openings where white can't be beaten when the strongest moves are made"....

    good joke...   

    I don't necessarily have a problem with Chessmaster's behavior or my assessment of it being inaccurate but, why do you say that? I have no problem with people make claims, even outlandish ones but, atleast give some evidence to back it up...

    My example for how one opening could be counted as superior another is simple. If an engine plays(against itself) all of the best moves of an opening line based on strength(I realize that this is perhaps the controversial, due to the way the programs choose moves) and there is a clear material/positional difference, in terms of, things like fewer moves needed to win, less vulnerability, more options to win, etc, can make one opening seem superior to another.

    I realize the human element changes this for most of us, but GM's play more like a computer (75-80% of their moves), so therefore, the opening itself could be considered better if it gives any noteable advantage.

  • 13 months ago · Quote · #10

    nameno1had

    uhohspaghettio wrote:

    nameno1had, I see you've put a lot of effort into your post, but you should know that your suggestion that because chessmaster beat itself using the king's indian and drew with the king's pawn opening must mean that the king's indian is superior is absololute nonsense.

    "we should try to make a list of openings where white can't be beaten when the strongest moves are made"....

    good joke...   

    It didn't draw itself with the King's pawn game, it lost with white. Are you suggesting it perhaps by random proposition( a programming feature) picked some lines in which white so happened to lose for my viewing pleasure, instead actually trying to do what I asked it to ....win?

  • 13 months ago · Quote · #11

    Sred

    nameno1had, where did you get the idea that a chess engine could be able to find the best move in any position?

  • 13 months ago · Quote · #12

    nameno1had

    Sred wrote:

    nameno1had, where did you get the idea that a chess engine could be able to find the best move in any position?

    Well, generally speaking, I never seem to be able to find better moves than it suggests. A few times I have wanted to play a different move than it suggests is best, but I think in those instances the result was going to be relatively the same.

    I believe what I do based on the criteria with which it is told to judge what the best moves are. The engines will generally out perform any human in my experience. It does this by calculating (reasonable speaking) all of the possible moves and chooses the line that gives it the best material/positional/time advantage.

    If you question the abilities of the best engines, is this because you or someone you know regularly out perform them? If so, please feel free to share...

  • 13 months ago · Quote · #13

    browni3141

    nameno1had wrote:
    Sred wrote:

    nameno1had, where did you get the idea that a chess engine could be able to find the best move in any position?

    Well, generally speaking, I never seem to be able to find better moves than it suggests. A few times I have wanted to play a different move than it suggests is best, but I think in those instances the result was going to be relatively the same.

    I believe what I do based on the criteria with which it is told to judge what the best moves are. The engines will generally out perform any human in my experience. It does this by calculating (reasonable speaking) all of the possible moves and chooses the line that gives it the best material/positional/time advantage.

    If you question the abilities of the best engines, is this because you or someone you know regularly out perform them? If so, please feel free to share...

    No one regularly outperforms engines, that isn't the point. You don't have to be better than them overall to be able to see their weaknesses. It really means nothing that an engine beat itself once in an opening. You can't draw conclusions based on one game and you since engines consistently misevaluate positions in some openings like the King's Indian you couldn't draw conclusions from even 1,000,000 games.

  • 13 months ago · Quote · #14

    browni3141

    Here's a very simple argument that engines don't play best chess.

    Engines beat eachother, therefore engines don't play best chess.

    It's not perfect but you will hopefully get what I mean.

  • 13 months ago · Quote · #15

    Sred

    nameof1had, I do not doubt the ability of chess engines to find excellent moves in most positions. They just do not find the best moves everytime, obviously (your argument seems to be based on that assumption).

    Btw: are you aware of the fact that chess programs usually use opening libraries, because their opening play is known to be bad?

  • 13 months ago · Quote · #16

    nameno1had

    browni3141 wrote:

    Here's a very simple argument that engines don't play best chess.

    Engines beat eachother, therefore engines don't play best chess.

    It's not perfect but you will hopefully get what I mean.

    They beat each other, but if we can't beat them, doesn't that give what I am saying some relevance? If that doesn't, consider the following idea to better clarify what I was intending for my words to mean.

    I wasn't assessing the engines performance for the sake of do they necessarily make the best moves, in terms of, whether the ones they are currently making, are the best possible that could ever be made, but instead was considering them the best possible we know of. They might not be the best possible, but still the best currently.

    Its like comparing two athletes of slightly different ability, from different eras and calling each each one the best respectively, though there is a clear difference in their ability/performance. They each in their own way could be the best.

  • 13 months ago · Quote · #17

    nameno1had

    Sred wrote:

    nameof1had, I do not doubt the ability of chess engines to find excellent moves in most positions. They just do not find the best moves everytime, obviously (your argument seems to be based on that assumption).

    Btw: are you aware of the fact that chess programs usually use opening libraries, because their opening play is known to be bad?

    My post # 18 will clarify what I was meaning.

    I will agree, when it comes to strategy, engines probably will only reflect the best ideas their programmers where able to try to instill in them. The trouble is, the rules for formulating strategy aren't like a set of absolute rules, that are without exception.

  • 13 months ago · Quote · #18

    Sred

    nameno1had wrote:

    My post # 18 will clarify what I was meaning.

    I see. But nevertheless, the best human chess players are still able to beat engines in correspondence chess, due to their superior strategical insight. In opening play, strategical insight is crucial - that's why chess engines use opening books created by humans.

    So I'm afraid that your approach won't create advancements in opening theory - not with the engines available now or in the near future.

  • 13 months ago · Quote · #19

    nameno1had

    Sred wrote:
    nameno1had wrote:

    My post # 18 will clarify what I was meaning.

    I see. But nevertheless, the best human chess players are still able to beat engines in correspondence chess, due to their superior strategical insight. In opening play, strategical insight is crucial - that's why chess engines use opening books created by humans.

    So I'm afraid that your approach won't create advancements in opening theory - not with the engines available now or in the near future.

    I guess will have to agree to disagree on this one. The only proof I have to offer is the last time the best player in the world played a computer, though he was able to win one game out of 6, he was thoroughly humbled. Need I add that both Rybka and Houdini are vastly superior to Deep Blue? Have you noticed that no GM has recently came forward to challenge Houdini to show their flaws? I watched a GM thoroughly demostrate, in a video on youtube,the best ways to try to beat engines. He said 10 years ago you had a chance, but the chance is literally all but gone with the latest advancements. If you wont take my word for it, maybe you will trust a GM's opinion...

  • 13 months ago · Quote · #20

    Sred

    nameno1had wrote:
    Sred wrote:
    nameno1had wrote:

    My post # 18 will clarify what I was meaning.

    I see. But nevertheless, the best human chess players are still able to beat engines in correspondence chess, due to their superior strategical insight. In opening play, strategical insight is crucial - that's why chess engines use opening books created by humans.

    So I'm afraid that your approach won't create advancements in opening theory - not with the engines available now or in the near future.

    I guess will have to agree to disagree on this one. The only proof I have to offer is the last time the best player in the world played a computer, though he was able to win one game out of 6, he was thoroughly humbled. Need I add that both Rybka and Houdini are vastly superior to Deep Blue? Have you noticed that no GM has recently came forward to challenge Houdini to show their flaws? I watched a GM thoroughly demostrate, in a video on youtube,the best ways to try to beat engines. He said 10 years ago you had a chance, but the chance is literally all but gone with the latest advancements. If you wont take my word for it, maybe you will trust a GM's opinion...

    1. I was talking correspondence chess.

    2. If you are right, why do engines use opening books?

    3. If you are right, why do Centaurs beat engines?


Back to Top

Post your reply: