Chess will never be solved, here's why

Sort:
Elroch

Well, both Leela and Stockfish prefer 1. ... d5 there. wink.png

MARattigan
tygxc wrote:

#2166
"There are non-mathematicians and non-mathematicians.
You are obviously one of the latter."
I am pretty sure I know more about mathematics than any of you, including the man with the 2 degrees.
Mathematics has since ancient times been applied to solve all kinds of problems, not to demonstrate that nothing can be concluded.

I assume you're referring to Gödel there.
Induction and deduction are the two main pathways of any science.

Do you really think any of your 4 curves represents the fraction of decisive games versus time?

No, but I thought you, as the World's greatest living mathematician, might.

Coming back to deriving the error rate E from the fraction of decisive games D, it is obvious that E =~D provided D is small enough.

Proof:
At 1 min / move the paper gives D = 0.021.
Under the generally accepted hypothesis that chess is a draw a decisive game contains an odd number of errors.
Thus
D = E + E^3 + E^5 + E^7 + ... = E / (1 - E^2)
Thus
E^2 - 1 + E/D = 0
Thus
E = sqrt ((1 / 2D)^2 + 1) - 1 / 2D
Keying in
D = 0.021
yields
E = 0.020990747
Thus E =~D
quod erat demonstrandum

Par for all your "proofs". If you check in a situation where it can be measured as I did here you get:

Fraction of decisive games = 0.1 (under your new game rules with 3-fold repetition - 0.0 under your new game rules with 2-fold repetition. Smaller than in your sample in a game different from whichever you propose to solve.)

Error rate per game = 3.0 (under your new game rules with 3-fold repetition - 2.7 under competition rules - haven't bothered to work it out under your new game rules with 2-fold repetition.)

0.1 is approximately equal to 3.0?

 

 

 

MARattigan
playerafar wrote:

By the way - consider Black's play in this game ...
and it doesn't even take fifteen seconds to consider it ...
g4 e5 f3 Qh4# checkmate.
Something 'imperfect' about black's play there? 

 Chance it's a perfect game if the starting position's a win for Black.

MARattigan
playerafar wrote:

There's even a theory that every chess game would end in a draw if nobody makes a mistake.
That's never been proven and might never be proven ...
(want it Disproven right away?  Lol !  Somebody doesn't make a mistake but they lose on the Clock !   )

Strictly speaking you can't lose on the clock under FIDE laws.

FIDE define the game as a physical game. 

For example only art. 4 determines that players must move their own pieces, by mandating that if the player having the move touches an opponent's piece he must capture it, which can be done only by moving one of his own pieces.

The definition of 'legal move' in art. 3  doesn't say anything about the conditions under which it may be played, it defines 'legal move' for both players at any point. It is left to other rules (arts. 4 and 5) to determine if those 'legal" moves are legitimate.

The dead position rule (art. 5.2.2) states:

The game is drawn when a position has arisen in which neither player can checkmate the opponent’s king with any series of legal moves. The game is said to end in a ‘dead position’. This immediately ends the game, provided that the move producing the position was in accordance with Article 3 and Articles 4.2 – 4.7.

If the player having the move has less than time d/c on his clock, where d is the minimum diameter of the base of his chess pieces and c is the speed of light, then it is impossible for him to complete a move (the force required to complete the move would in any case exceed the shearing force of the piece or the fingers of the one hand with which he must make the move sometime earlier).

So whenever a player fails to complete the required number of moves in the allotted time according to art. 6.3.1 a dead position has occurred at some time strictly earlier terminating the game in a draw.

DiogenesDue
1c4Boom1-0 wrote:

so reading a novel and writing & reading forum posts about something are the same. good. people can talk about chess being solvable or unsolvable but this level.. is beyong the necessity. if you know too much this topic why dont you write a program, make a product instead of this. besides no one will read all of this.. thousands of pages will be lost here even if they had useful information. write a book, form a product.. so people can use. whats this?

Always gotta be someone to complain about wasted time with their own wasted time wink.png.  Shoo.  Go live your life and don't worry about other people's time spent.

Elroch

I am sure we all feel there is far too little consideration of the relevance of the lack of unique simultaneity in relativistic space-time to the interpretation of the rules of chess.

[wink.png]

1c4Boom1-0

@btickler I never talked about time. It was all about the unnecessity of talking about something that much, which is not useful or anything. Too much information is wasted between pages. And why don't you make something useful if you all have that much information on the topic. I said. You are just twisting my words. Like almost anyone who disagrees.

MARattigan
tygxc wrote:

#2152

About your objectivity and honesty, then, maybe you want to comment this excerpt from the very paper on checkers you cited so much:

"With checkers done, the obvious question is whether chess is solvable. Checkers has roughly the square root of the number of positions in chess (somewhere in the 10⁴⁰ - 10⁵⁰ range). Given the effort required to solve checkers, chess will remain unsolved for a long time, barring the invention of new technology."

That was in 2007. The 10^40 - 10^50 range is no longer valid.

Schaeffer was talking about positions in the absence of the 50 move and triple repetition rules. The removal of these from FIDE's basic rules in 2017 serves only to make the figures correct for the basic game.

Nothing has happened in the meantime to invalidate that range as far as the basic rules game is concerned. Chess has not shrunk.
The papers by Tromp (10^44) and Gourion (10^37) are from 2021.

The figure 3 x 10^37 is for diagrams without excess promotions, and is not in any way relevant. It changes neither Schaeffer's range nor Tromp's estimate (circa 4 x 10^44), which also relates to the basic rules game.

The number of positions in your proposed game of basic rules + two and a Schrödinger's half fold repetition rule would be vastly greater, because then positions must be defined effectively by a pgn from a ply 0 position - different positions for different pgns leading to the same fen.
In those 15 years also computers have become faster and chess engines better, now 10^9 nodes/s.
Also progress has been made on the 7-men endgame table bases.
Most of the effort of Schaeffer was related to building his endgame table base.

Schaeffer himself also said:
”The one thing I’ve learned in all of this is to never underestimate the advances in technology”
https://webdocs.cs.ualberta.ca/~jonathan/publications/ai_publications/checksolved.pdf 
final line

Interesting to note from the paper you quote that checkers has not in fact been weakly solved, nor even fully ultra weakly solved.

 

Elroch

I think you mean that the paper says checkers has not been strongly solved. Strategies for optimal play from the opening position are complete. This only meant about 10^14 calculations (so certainly not the full 10^20 positions). The 10 piece endgame tablebase for the solution has 39 trillion positions, which is between 10^13 and 10^14 positions.

playerafar


@MARattigan
Quote from your post:
"Strictly speaking you can't lose on the clock under FIDE laws."

That doesn't sound right to me At All.
You play in a FIDE rated tournament.
You make 'perfect' moves - or maybe you don't.
Your opponent calls 'Flag' in a loud clear voice. 
Because you've 'overstepped' on time.  On the clock.
You're Done.  Lost.  Defeated.  Fried.  Clobbered.  Eliminated.
Flattened. Deprived. Sent packing. Dismissed. Eclipsed. Diminished.
Fricasseed.  Broiled.  Squashed.  Eviscerated.  Dissected.  Vivisected.
Same result as Checkmate.

DiogenesDue
1c4Boom1-0 wrote:

@btickler I never talked about time. It was all about the unnecessity of talking about something that much, which is not useful or anything. Too much information is wasted between pages. And why don't you make something useful if you all have that much information on the topic. I said. You are just twisting my words. Like almost anyone who disagrees.

Ermm...you cannot really talk about the uselessness of anything unless you first consider it a waste of time.  There's nothing useful to be done on actually solving chess at this time...the only useful outcome of this thread is to dispel that very notion.

Telling people to make better use of their time implies that you know better what somebody wants/needs from their life than they do.  We already have enough posters that think their words are correct, but always twisted by everybody else that reads them, thanks anyway wink.png...

 

Elroch
playerafar wrote:

By the way - consider Black's play in this game ...
and it doesn't even take fifteen seconds to consider it ...
g4 e5 f3 Qh4# checkmate.
Something 'imperfect' about black's play there? 

Well, both Leela and Stockfish prefer 1. ... d5 there. wink.png

I just accidentally left Leela analysing 1. g4 for a couple of hours on a GPU and its evaluation was 69% for 1. ...d5 and only 59.5% for 1. ...e5, a surprisingly large difference.

playerafar

@Elroch
Interesting about that d5 preference there.
But that might be because d5 is simply a better move anyway.
Like d4 is arguably the best first move for white.
Solider than e4 for multiple reasons.

playerafar

@MARattigan
Quote from your post:
"Strictly speaking you can't lose on the clock under FIDE laws."

Maybe that's Martin just teasing player ??  happy.png  See post #2191

tygxc

#2210

"Chess has not shrunk."
++ Chess has not shrunk, but it is smaller than Schaeffer believed in 2007.
The papers by Tromp (10^44) and Gourion (10^37) are from 2021.

"It changes neither Schaeffer's range nor Tromp's estimate (circa 4 x 10^44)."
++ Tromp's estimate 10^44 has no relevance to solving chess, as none of his 538 randomly sampled positions found legal can result from the initial position by a game with more than 50% accuracy. All of his 538 positions found legal contain multiple underpromotions to pieces not previously captured.

"The figure 3 x 10^37 is for diagrams without excess promotions"
++ That makes it very relevant. Diagrams = positions, as for any diagram with white to move there is a position with black to move by up/down symmetry. Promotions to pieces not previously captured do happen in less than 1% of games, and mostly to queens, not underpromotions. Underpromotions may happen in less than 0.1% of games.
If you want you can multiply 10^37 by 10 to include positions with 3 or 4 queens.
That leaves 10^38.
Even this number is much too large, as a random sample of 10,000 positions without promotions to pieces not previously captured shows the positions cannot result from the initial position by a game with more than 50% accuracy. Tromp conjectured than only 1 in 10^6 might be sensible. That would leave 10^32 sensible positions including those with 3 or 4 queens.
So the range is rather 10^32 - 10^38 according to knowledge of 2021.

"The number of positions in your proposed game of basic rules + two and a Schrödinger's half fold repetition rule would be vastly greater, because then positions must be defined effectively by a pgn from a ply 0 position - different positions for different pgns leading to the same fen."
++ This is nonsense. The 50-moves rule is never invoked in practice before the 7-men endgame table base is reached. I challenged you to provide one single grandmaster or ICCF game under any rules where the 50-moves rule was or could be invoked in a position with 8 men or more. I bet no such game exists at all.

MARattigan
Elroch wrote:

I think you mean that the paper says checkers has not been strongly solved. Strategies for optimal play from the opening position are complete. This only meant about 10^14 calculations (so certainly not the full 10^20 positions). The 10 piece endgame tablebase for the solution has 39 trillion positions, which is between 10^13 and 10^14 positions.

I was referring to the comments:

(a)

 The fact that the game wasn’t solved for every possible position and then tucked away in a database doesn’t seem to bother him. ”Well, the checkers players would love it, because [then] you’ve got this oracle that can tell them everything—answer every single unanswered question in the game of checkers,” he says. ”But first of all, I don’t have the patience to do it. And second of all, I don’t have the technology to do it.” Even with the best data-compression techniques, Schaeffer says, the amount of storage required to solve all possible positions of checkers would exceed even the capacity of the world’s biggest supercomputers with tens of petabytes (1015) of storage by an order of magnitude. That puts it—at the earliest—at least a decade away.

and

(b)

Schaeffer’s proof solved checkers for 19 different openings, all of which end in draws. There are 300 total tournament openings, but many of these were determined to either be mirrors of other positions or altogether irrelevant to the proof because they lead to positions common to other openings.

or from https://www.researchgate.net/publication/231216842_Checkers_Is_Solved 

The checkers proof consisted of solving 19 three-move openings, leading to a determination of the starting position’s value: a draw. Although there are roughly 300 three-move openings, over 100 are duplicates (move transpositions). The rest can be proven [not have been proven] to be irrelevant by an Alpha Beta search.

(a) apparently means there is no algorithm provided that tells each player what moves to make from the opening, only that the moves have been checked by computer and shown to be a draw - so on the face of it an ultra weak solution. (OK it's actually talking about a strong solution database there - but is there a weak solution database?)

except

(b) suggests the ultra weak solution is at most 19/200ths. complete. (Transpositions removing 100 of the original 300 obviously valid.) For a solution of any kind all possible openings must be dealt with.

(When I try to see details of the proof using the https://webdocs.cs.ualberta.ca/~chinook/solution/ link given in the link above, the checkers solution times out.)

tygxc

#2218
"Schaeffer’s proof solved checkers for 19 different openings, all of which end in draws.
There are 300 total tournament openings"
That is what I say about chess all the time.
Of the 500 ECO codes A00 to E99 only 50 are necessary to weakly solve chess.
If 1 e4 e5 is proven a draw, then it is not necessary to determine if 1 e4 c5 draws as well or not.
If 1 e4 and 1 d4 are proven draws, then it is not necessary to verify that 1 a4 draws as well.
If 1 e4 e5 2 Nf3 is proven a draw, then it is not necessary to look at 1 e4 e5 2 Ba6.

MARattigan
tygxc wrote:

#2218
"Schaeffer’s proof solved checkers for 19 different openings, all of which end in draws. There are 300 total tournament openings"
That is what I say about chess all the time.
Of the 500 ECO codes A00 to E99 only 50 are necessary to weakly solve chess.
If 1 e4 e5 is proven a draw, then it is not necessary to determine if 1 e4 c5 draws as well or not.
If 1 e4 and 1 d4 are proven draws, then it is not necessary to verify that 1 a4 draws as well.
If 1 e4 e5 2 Nf3 is proven a draw, then it is not necessary to look at 1 e4 e5 2 Ba6.

Understood. But you're obviously wrong.

haiaku

@Marattigan

To weakly solve a game it is enough to provide an optimal strategy in a reasonable time, so to save storage space, you can leave out some lines and provide them on demand, but you have to know, after tests, that they can be provided on demand.

MARattigan wrote:

Schaeffer’s proof solved checkers for 19 different openings, all of which end in draws. There are 300 total tournament openings, but many of these were determined to either be mirrors of other positions or altogether irrelevant to the proof because they lead to positions common to other openings.

For chess, If one sits at the board against SF and has weakly solved the game, s/he will make some moves using the proof tree, some others can be calculated by an engine, but it must hit an endgame tablebase or an already solved position in reasonable time. Instead, if s/he uses an engine just to evaluate the position as usual, they will likely draw against an equally strong silicon opponent, but the moves would be just the result of evaluations/guesses: if they use the same engine 10 years later against a much stronger opponent, they would lose most of the games. If chess was indeed weakly solved, on the other hand, they would replicate the same outcome with the very same silicon ally even 1000 years later.

MARattigan
tygxc wrote:

#2210

"Chess has not shrunk."
++ Chess has not shrunk, but it is smaller than Schaeffer believed in 2007.

No it's not. Tromp's figure is in Schaeffer's range.
The papers by Tromp (10^44) and Gourion (10^37) are from 2021.

Whether a paper is valid doesn't depend on the publication date. Both papers are valid - your use of the second is not.

"It changes neither Schaeffer's range nor Tromp's estimate (circa 4 x 10^44)."
++ Tromp's estimate 10^44 has no relevance to solving chess, as none of his 538 randomly sampled positions found legal can result from the initial position by a game with more than 50% accuracy. All of his 538 positions found legal contain multiple underpromotions to pieces not previously captured.

Firstly you're not proposing to solve chess. As far as I am aware no game referred to as "chess" that excludes the 50 move rule but includes either a 2-fold or 3-fold repetition rule has ever been prevalent.

Secondly, if whatever you propose to solve turns out to be a draw, then, using your method will need to consider all Black responses and also show that its a draw for all alternative White moves at any stage. This will result in a majority of games that look rather different from those you see at your local chess club.

You're good at issuing challenges. I challenge you to prove (or even convincingly demonstrate) just a single one of Tromp's 538 positions cannot result from the initial position by a game with more than 50% accuracy.

But if you could, that wouldn't say anything about the positions you would encounter in your computation.

"The figure 3 x 10^37 is for diagrams without excess promotions"
++ That makes it very relevant. Diagrams = positions, as for any diagram with white to move there is a position with black to move by up/down symmetry.

Diagrams ≠ positions

These are the same diagrams


 

 

But in the competition rules game they're not the same position. The first position is winning for White, the second position is a draw.

You can't have the same position with different theoretical results.

In either a variant of competition rules chess that excludes the 50 move rule or a variant of competition rules chess that excludes the 3-fold repetition rule, the second position would also be winning for White. That wouldn't make the positions the same in the former case because the possible forward play in each would be different.

(In your basic rules + 2-fold repetition game both positions are illegal because the game has already terminated; in your basic rules + 3-fold repetition game the second position is a win.)

You seem to have extraordinary difficulty in grasping that the same diagram can belong to different positions in different games or the same games. 

Promotions to pieces not previously captured do happen in less than 1% of games, and mostly to queens, not underpromotions. Underpromotions may happen in less than 0.1% of games.

You should be interested in the positions your proposed procedure needs to consider to complete, not what happens at your local chess club.
If you want you can multiply 10^37 by 10 to include positions with 3 or 4 queens.
That leaves 10^38.

I don't want.

If it were I investigating the feasibility of your approach, I would start off with Tromp's relevant estimate of positions under basic rules and then multiply by different factors depending on the game to be solved. 

The necessary factors are complicated to work out when an n-fold repetition rule is included in the game. That is because a position specification is then a pgn as opposed to a fen.

The tablebase generation procedures neatly bypass the n-fold repetition problem by never producing positions with the same diagram and side to move with different distances to their respective objectives.

Your procedure doesn't detail how it is proposed to get around the problem. SF14 (your proposed vehicle) happily repeats positions up to twice whether it thinks it's winning or not. With your new two and a Schrödinger's half-fold repetition rule half of the SF14 vs. SF14 games here would be drawn under the 2-fold repetition rule when observed. 

An upper bound on the number of positions in you search space would be

2.9 x 10^44 x (n^(2.9 x 10^44)) where n is either 2 or 3 depending on when it is observed. The upper bound is obviously far too high and could easily be reduced - I leave it to you to reduce it.

Even this number is much too large, as a random sample of 10,000 positions without promotions to pieces not previously captured shows the positions cannot result from the initial position by a game with more than 50% accuracy.

As I pointed out that's irrelevant - but I await the result of my challenge with interest.

Tromp conjectured than only 1 in 10^6 might be sensible.

Of his basic rules positions. That has no relevance to a solution along your proposed lines of even a solution to the basic rules game.

That would leave 10^32 sensible positions including those with 3 or 4 queens.

Actually 4 x 10^44 / 10^6 is 4 x 10^38 - I should check your calculator installation.
So the range is rather 10^32 - 10^38 according to knowledge of 2021.

Or not as the case may be.

"The number of positions in your proposed game of basic rules + two and a Schrödinger's half fold repetition rule would be vastly greater, because then positions must be defined effectively by a pgn from a ply 0 position - different positions for different pgns leading to the same fen."
++ This is nonsense. The 50-moves rule is never invoked in practice before the 7-men endgame table base is reached. I challenged you to provide one single grandmaster or ICCF game under any rules where the 50-moves rule was or could be invoked in a position with 8 men or more. I bet no such game exists at all.

I didn't mention the 50 move rule. The relevance of the ply count 0 position is that no positions as defined for the purposes of art. 9.2.1 that occurred previously can occur subsequently.

(Again, what happens at your chess club, whether or not they're playing the same game as you're trying to solve, is of no relevance.)