Chess will never be solved, here's why

Sort:
tygxc

@6968

"understanding something on a conceptual level is completely different from making use of that concept in a programming language and even more so in a rigorous context such as solving chess."
++ That is where the good assistants come in. They launch the calculations. They occasionally terminate the calculations. The rule is not incorporated in Stockfish, the good assistants judiciously apply it to decide if Stockfish calculation is to be launched or not.
Let us see a few examples
1 e4 e5 2 Ba6?
1 e4 e5 2 Nf3 Nc6 3 Nxe5?
Is there material gain? Yes.
Is everything else the same? Yes, per judgement of the good assistants.
Conclusion: these are certain losses for white and do not need any calculation.

1 e4 e5 2 Nf3 Nc6 3 Bc4 Nf6 4 Ng5 d5 5 exd5 Na5
1 e4 e5 2 Nf3 Nc6 3 Bc4 Bc5 4 b4
Is there material gain? Yes.
Is everything else the same? No, there is some compensation that may or may not be sufficient.
Conclusion: calculate.

"Saying "we'll just program it to ignore bad moves" is intensely naive."
++ We do not change Stockfish, we use Stockfish like Schaeffer used Chinook for Checkers,
but the good assistants decide what to calculate and what not to calculate.

llama36
tygxc wrote:

That is where the good assistants come in. They launch the calculations. They occasionally terminate the calculations.

What you're talking about is not solving chess, not when "solve" is used in a technical sense. Not weakly solved or partially solved or softly... whatever adjective you want, it's not solving.

tygxc

@6970

I am talking about weakly solving Chess, just like Schaeffer did for Checkers, or Allis did for Connect Four.
Prof. van den Herik wrote incorporating game knowledge is beneficial in game solving.
It is pointless to burn computer time on 1 e4 e5 2 Ba6? or 1 Nh3.
It is pointless to burn computer time on a known drawn opposite bishop endgame until a 3-fold repetition.
That is the difference between 5 years doing it the smart way as opposed to 500 years doing it the stupid way.

llama36
tygxc wrote:

@6970

I am talking about weakly solving Chess, just like Schaeffer did for Checkers, or Allis did for Connect Four.
Prof. van den Herik wrote incorporating game knowledge is beneficial in game solving.
It is pointless to burn computer time on 1 e4 e5 2 Ba6? or 1 Nh3.
It is pointless to burn computer time on a known drawn opposite bishop endgame until a 3-fold repetition.
That is the difference between 5 years doing it the smart way as opposed to 500 years doing it the stupid way.

Ok, but you need a way to sort which positions are necessary to look at.

tygxc

@6973

"Ok, but you need a way to sort which positions are necessary to look at."
++ That is why the good assistants i.e. grandmasters are needed.
They decide what starting positions to submit to Stockfish for calculation.
They occasionally terminate a calculation like with known drawn opposite colored bishops.

llama36
tygxc wrote:

@6973

"Ok, but you need a way to sort which positions are necessary to look at."
++ That is why the good assistants i.e. grandmasters are needed.
They decide what starting positions to submit to Stockfish for calculation.
They occasionally terminate a calculation like with known drawn opposite colored bishops.

I'm asking how to determine which of the 10^44 positions are necessary to explore. It sounds like you're saying engines will start out by attempting to evaluate all of those positions, and will only stop when a human stops them.

That isn't a solution. That's just some GMs with an engine who are storing a lot of analysis.

tygxc

@6975

"how to determine which of the 10^44 positions are necessary to explore"
++ That is the wrong question. Schaeffer did not ask how to determine which of the 10^20 positions were necessary to explore. After just 10^14 Checkers was weakly solved. The purpose is to explore the tree starting from the initial position through drawn positions to end in 7-men endgame table base drawn positions.

"It sounds like you're saying engines will start out by attempting to evaluate all of those positions" ++ No, humans decide from which positions to start calculating. Humans decide not to submit 1 e4 e5 2 Ba6? for calculation.

"will only stop when a human stops them" ++ No, the calculation stops when a 7-men endgame table base position or a prior 3-fold repetition is reached. Humans occasionally halt a calculation e.g. when a known drawn opposite colored bishop endgame is reached, that would be pointless to calculate until a 3-fold repetition. Such human terminations are the exception. 

"That isn't a solution. That's just some GMs with an engine who are storing a lot of analysis."
++ It is a solution. If every relevant opening is calculated until a 7-men endgame table base draw or a prior 3-fold repetition, then Chess is weakly solved.

An analysis ends in some evaluation.
A solution ends in a 7-men endgame table base draw.

llama36
tygxc wrote:

If every relevant opening is calculated until a 7-men endgame table base draw or a prior 3-fold repetition, then Chess is weakly solved.

Yes, but you need a way to determine which positions are relevant. Humans are slow and fallible.

You keep giving the example of losing a piece on move 2 as if all irrelevant positions are easy to determine.

tygxc

@6977

"You keep giving the example of losing a piece on move 2 as if all irrelevant positions are easy to determine." ++ I give that example as some here still do not understand why 1 e4 e5 2 Ba6? needs no further calculation. The good assistants need to be (ICCF) (grand)masters so they only make 100% sure decisions on what position to submit for calcuulation and what not.

coolsim12
Hi
RemovedUsername333

@6960

There are several logical and mathematical errors in the provided statement. Firstly, the claim that "a full bishop up, no compensation of any kind is a win" is incorrect. While having a bishop advantage can often be a significant advantage in chess, it is not a guarantee of victory. It is possible for a player with a bishop advantage to lose the game, especially if their opponent has other compensating factors such as a material advantage or a superior position.

Additionally, the claim that "a tempo up is enough to win" is also incorrect. A tempo is simply the time it takes a player to make a move, and while having an extra tempo can be advantageous, it is not a guarantee of victory.

The statement that "1 e4 e5 2 Ba6? is a forced checkmate for black" is also incorrect. While the move 2...Ba6 may be a strong move for black, it is not a forced checkmate. It is possible for white to defend against this attack and potentially even gain an advantage.

Furthermore, the calculation of the Shannon number as 10^120 is incorrect. The Shannon number represents the total number of possible chess games, not the number of possible positions. The correct calculation of the Shannon number is significantly larger than 10^120.

The assertion that weakly solving chess without any game knowledge would take 100,000 years is also flawed. This calculation is based on incorrect assumptions about the number of legal positions and the number of possible moves per ply, and does not take into account the fact that many positions can be evaluated much more quickly using chess engines and databases.

It is important to carefully consider the evidence and reasoning behind any claims, particularly when it comes to complex topics such as chess.

Botlosenik
TsetseRoar wrote:

Strange thread...most people seem to have no idea what "solving" a game means.

Solving a game does not mean being dominant over all other humans...otherwise chess was "solved" by Morphy, even though we can find many suboptimal moves in his play now.

Solving also doesn't mean calculating every permutation. 

What it means is a mathematically best strategy has been shown -- either an unstoppable strategy that always wins for one player, or a strategy that forces a draw (where an unstoppable can be proved to not exist).

At this time, the game of chess has not been solved, but there is no reason why it is impossible, or intractable.

I think Go will be solved before chess, and when that happens we can suspect chess is coming soon. Go has many more permutations than chess, so is sometimes described as a more complex game, but I think, given only one kind of "piece" and "move" it looks a better candidate for finding an unbeatable strategy.

 

Strange thread indeed. Your definition of "solved" is far better than other posts I have seen here. I suppose I will only be elaborating on what you have said.

It is quite straight forward to solve TicTacToe for example (if it hadn't been already solved) by simply testing every single move for each player in each possible position, and find which lines give what result. It is note quite clear to me whether you meant to rule that out. Anyway, while this method seems like a silly (as in inefficient) way to do it, it leads to simpler code logic which may have advantages. For example, solving a really difficult game like chess or Go may require specialized hardware, and depending on what this hardware is based on, "simple logic" may be the biggest factor for being able to make it efficient.

As far as I know there are only two ways to improve on the oversimplified method mentioned above (they probably can and will be combined). Advances in hardware and advances in method of exploring the searchspace.

Advances hardware would include both efficiency and memory size. To make this the deciding factor would require improvements of a magnitude that are not likely for many decades to come. With current speed of hardware improvement, I would guess at least several hundred years.

I can see only two types of possible efficiency improvement techniques for exploring the searchspace.

One speedup technique is in improving the method of going through a searchspace regardless of game. For example a method to avoid calculating the score (won/drawn/lost) for the same position (including 90 degree rotations and so on) many times, similar to the use of hashtables in chess engines (this is just an example, many others exist, like starting from end positions and calculating backwards). This speedup technique has been studied quite a bit, and it is unlikely that huge new advances will come of it, and even if they do, the searchspace will necessarily still simply be way too big for it to be a deciding factor alone. Our current chess endgame databases ( https://en.wikipedia.org/wiki/Endgame_tablebase ) are still not able to handle 8 pieces, and the database size increases exponentially for each added piece.

The second speedup technique is "game strategy based speedup methods", like if a king is too far behind a pawn, it cannot ever stop it from becoming a queen by simply running after it, no matter which path it chooses. Such a breakthrough could also be that you find some kind of connection between positions (like "if pos X is won, then pos Y is too"), or maybe a kind of rule of how to play ("always play Qc4 if the following conditions are met : ....") or maybe something else. However, there is no reason to feel confident that it will be possible to find such game strategy based speedup methods that are general enough to cut the search tree enough to sufficiently simplify the job of searching through the whole search-tree, either for chess or go. It seems to me nearly impossible to rule it out as a theoretical possibility, while it still seems very unlikely.

To sum up, I don't think even deciding if starting pos is won for white or a draw is within our grasp for many decades. I don't even know if we can soon prove that it is not won for black (harder than you might think: https://www.reddit.com/r/chess/comments/7opnjn/is_it_provable_that_black_could_never_force_a_win/ ).

As for "go vs chess", which is solved first, I disagree. Simpler rules for Go may make it more probable to find a "game strategy based speedup method", but only "more probable", not "probable". I still think it is quite unlikely. The other possibility would be that it is easier to make some specialized hardware rig that handles Go in a novel way which gives insane speedup, than for chess, as chess has more complicated rules, but I see no reason to believe that this is more of a deciding factor than the smaller board and so on for chess. My guess would be that if they ever get solved, chess is solved before Go, and that there would be quite a gap in time between them.

Botlosenik
tygxc wrote:

@6968

Is there material gain? Yes.
Is everything else the same? Yes, per judgement of the good assistants.

I may not have interpreted "weakly solve" correctly, but "is everything else the same?", how much "the same" must they be, and what to do when the "good assistants" disagree, or agree but are wrong? There are certainly positions where the absolute world elite players disagree on this issue, which proves at least one of them must be wrong in each case. And you can find positions with stuff that probably no human will judge correctly in a consistent manner (unless given stupendous amounts of time), positions where you have "computer moves" that you can, after being told there is something there, perhaps work it out, but you would never have guessed beforehand. Do you suggest we just ignore all such issues?

tygxc

@6983

"is everything else the same?, how much the same must they be"
++ The same is the same, like 1 e4 e5 2 Ba6?

"what to do when the good assistants disagree" ++ They should never disagree.
They should only cut short on what they are absolutely sure about, like 1 e4 e5 2 Ba6?

"or agree but are wrong?" ++ That should never happen.
That is why good assistants are needed, e.g. (ICCF) (grand)masters.

"There are certainly positions where the absolute world elite players disagree on this issue"
++ Most positions, in that case: calculate.
The shortcut is only to avoid useless calculation like 1 e4 e5 2 Ba6?

"find positions with stuff that probably no human will judge correctly in a consistent manner"
++ Most positions are such that neither human, nor engine can evaluate.
That is why in most positions just calculation is in order until the 7-men table base is hit.

tygxc

@6981

"the claim that a full bishop up, no compensation of any kind is a win is incorrect."
++ So you know it better than Capablanca who said so?

"a bishop advantage can often be a significant advantage in chess, it is not a guarantee"
++ It is.

"It is possible for a player with a bishop advantage to lose the game"
++ Yes if he errs he may even lose a queen up. We talk about optimal play from both sides.

"if their opponent has other compensating factors"
++ Then everything else is not the same.

"Additionally, the claim that a tempo up is enough to win"
++ I say on the contrary a tempo up is not enough to win. To win needs a pawn or more.

"The statement that 1 e4 e5 2 Ba6? is a forced checkmate for black is also incorrect."
++ I gave a proof game above.

"It is possible for white to defend against this attack and potentially even gain an advantage."
++ If black makes a mistake, but not with optimal play by both sides.

"The assertion that weakly solving chess without any game knowledge would take 100,000 years is also flawed." ++ No it is correct.

"incorrect assumptions about the number of legal positions"
++ Tromp has proven that there are 10^44 legal positions and Gourion has proven there are 10^37 legal positions without promotions to pieces not previously captured.

"many positions can be evaluated much more quickly using chess engines and databases"
++ The only sure evaluation is the 7-men endgame tablebase.

"It is important to carefully consider the evidence and reasoning behind any claims, particularly when it comes to complex topics such as chess."
++ That is why I take care to explain the facts and figures and back them up with references.

MARattigan
tygxc wrote:

@6981

"the claim that a full bishop up, no compensation of any kind is a win is incorrect."
++ So you know it better than Capablanca who said so?

"a bishop advantage can often be a significant advantage in chess, it is not a guarantee"
++ It is.

...

If you say so Ty.

White to move

 

tygxc

@6986

Near the initial position.
This is another weird artificial construct.
Even 5 underpromotions to bishops.
Otherwise it is a known 4-men KBP vs. K draw.

Botlosenik
tygxc wrote:

@6983

"is everything else the same?, how much the same must they be"
++ The same is the same, like 1 e4 e5 2 Ba6?

++++ This is not exactly the same. Without a definition, in fact, even with a definition, even only one assistant will give different answers at different times. Humans just aren't as consistent as you believe.

"what to do when the good assistants disagree" ++ They should never disagree.
They should only cut short on what they are absoltely sure about, like 1 e4 e5 2 Ba6?

++++ How "absolutely" sure? Given that the same person will give different answers to the same such issue, given different moods, different times of day and so on, the word "absolutely" is not as clear as you believe. Absolutely sure as in "9 out of ten times I will be right"? As in 99999 out of 100000?

"or agree but are wrong?" ++ That should never happen.
That is why good assistants are needed, e.g. (ICCF) grand(master)s.

++++ It most definitely will happen. Even the same GM will change opinion on such matters over time.

"There are certainly positions where the absolute world elite players disagree on this issue"
++ Most positions, in that case: calculate.
The shortcut is only to avoid useless calculation like 1 e4 e5 2 Ba6?

++++ It is absolutely not clear to me that given perfect play by both players after these moves changes status of the position. It could very well be that starting pos is a draw, and after Ba6 it is still draw.

"find positions with stuff that probably no human will judge correctly in a consistent manner"
++ Most positions are such that neither human, nor engine can evaluate. That is why in most positions just calculation is in order until the 7-men table base is hit.

++++ So most of the time the assessment of the assistant is unnecessary (he dares not say he is sure), some of the time it is wrong (humans make mistakes), and all of the time it is an incredible slowdown. I don't think you understand how much of a slowdown it gives. Deep Blue was capable of evaluating 200 million positions per second (you can use a different number if you want, this was just the number I found that was easiest to find). You want to put a human in there to evaluate every position where there is a clear material difference. Now suppose the position is such that one player is down a piece but may or may not have sufficient compensation. Lets say something like e4 a6 Bxa6 Nxa6. Pretty much any move done by either side from that position will lead to another position where white is down a bishop ish, and question is whether there is compensation or "everything is equal". Let's say half the positions are like that. Give him one second per position, and he will still spend 100 million seconds to check each one of them.  You really think this is a good idea? I hope you are aware that computers typically do selective search already, so they do spend less time on weak moves? And that analysis of a bad move typically can be performed much faster than OK moves using alpha beta cutoff or similar methods since you get faster to positions that are shown to be suboptimal? Or the Alpha Zero algorithm, which will use neural nets to do super fast and often superior guesses of the value of a position without the need for a human?

 

MARattigan
tygxc wrote:

...

Otherwise it is a known 4-men KBP vs. K draw.

Same applies.

What's your point? How does it contradict, "a bishop advantage can often be a significant advantage in chess, it is not a guarantee"?

DiogenesDue
tygxc wrote:

@6986

Near the initial position.
This is another weird artificial construct.
Even 5 underpromotions to bishops.
Otherwise it is a known 4-men KBP vs. K draw.

You can't use this caveat all the time.  What you are freely admitting is that the absolute values you are claiming are not absolute, they are fluid, ergo your estimates built on them are garbage.  A tempo is not worth 0.33, and a bishop is not worth 3.  These are approximations of estimates.   The values are fluid.  Now, could you determine the average of all these fluid values and assign an accurate average value to them?  Yes.  By solving chess.  Your premise is entirely backwards.  You propose to use a bunch of inaccurate data and imperfect analysis to determine these values...but you are trying to bootstrap using analysis dependent on the faulty values you are trying to determine.  It's not hard to understand.

Your bishop assertion is drawn from Capablanca, taken out of context, and is ridiculous, since a minor piece up is the textbook example of not having enough material to mate alone.  It is easy to set up a vast number of positions where having extra tempi of any amount is still losing. 

It's New Year's Eve.  Time to move on from your unbreakable windmill.