Chess will never be solved, here's why

Sort:
MARattigan
Optimissed wrote:
...

I would remind you that it's almost always you who brings up the subject of IQ. ...

What a whopper!

tygxc

@7501

"Suppose there are 10^20 good-looking lines from some hypothetical position until you reach known tablebases. 99.9999999999% are wins for the player with a conventional advantage. 10^8 are draws. Any GM is going to see this as a completely winning position."
++ No. It may be that some line is good-looking, but if it is a draw, then it is found sooner or later. That is what we see: some lines are very popular and then disappear from tournaments.

"we haven't factored the 10^50 or whatever lines that have nonsense-looking computer moves in them that only a tablebase would even think about but turn out to be important."
++ There are only 10^44 legal positions and the vast majority of them are absolute nonsense with 3 rooks or bishops at both sides, which can never happen with optimal play from both sides.

If we restrict promotions to pieces previously captured, there are only 10^37 positions and the vast majority of these cannot happen from optimal play by both sides either.
Inspection of a random sample of 10,000 such positions reveals none can result from optimal play by both sides either. You can check for yourself and take one of the 10,000 randomly sampled FEN and try to construct a game that leads to it. That leads to 10^37 / 10,000 = 10^33 positions.

Allowing only promotions to pieces previously captured is a bit too strict, as positions with 3 or 4 queens do occur in perfect games of ICCF WC Finals draws, so multiply by 10 to accept 3 or 4 queens, leaving 10^33 * 10 = 10^34 positions.

Weakly solving only needs 1 black response to draw, not all black responses. That leads to a square root: not w^2d but w^d = Sqrt (w^2d), e.g. not 20*20 = 400, but 20*1 = 20 = Sqrt (400). Thus Sqrt (10^34) = 10^17 relevant positions.

Cloud engines of a billion nodes/s can calculate that from opening to 7-men endgame table base in 5 years.

MARattigan
tygxc wrote:

@7426

"worst moves according to an unreliable evaluator that you know to be entirely wrong sometimes (i.e. the move it thinks is best is a losing blunder)."
++ I have even quantified the error rate: 1 error in 10^5 positions for a 10^9 nodes/s engine calculating 17 s/move.

The flaws in your method have already been pointed out.

You say here 

Your desktop is 1000 times slower than a cloud engine of 10^9 nodes/s. Time * 60 gives 5.6 times less error. 

If you were to look at these games as you steadfastly refuse to do, you will notice that four of them were played at 37 mins. per move. According to your figures, 17 sec. per move on your cloud engine is equivalent to about seven and a half times the time I  allocated on my desktop, so according to your "calculation" these games should have 1 half point blunder in around 42,500 ply.

The four games have a total of 290 ply so according to your "calculation", the expected total number of half point blunders in the games is about 0.007.

User @cobra91 has carefully checked the actual total with the Syzygy tablebase here. It comes to 11.

YOUR CALCULATIONS DON'T WORK. CAN YOU STOP POSTING THEM, PLEASE?

Thus 1 case in 10^20 positions where the table base exact move is not among the top 4 moves of the 10^9 nodes/s engine running 17 s/move.

Thus nothing, of course.
As only 10^17 positions are relevant to weakly solving Chess,
that means 0.001 error in the solution, i.e. not a single error at all.

Apart from obviously not, from the above; what solution? You're not even planning a solution according to any sensible definition.

The peer reviewed paper 'Games solved: Now and in the future' by Prof van den Herik states:
'it is often beneficial to incorporate knowledge-based methods in game-solving programs'

Problem is you don't seem to have any.

The peer-reviewed paper 'Acquisition of Chess Knowledge in AlphaZero' has 'knowledge' in its title. It leads to things we know, not things we guess, believe, or think.

It leads to things AlphaZero guesses. You use "guess" and "know" interchangeably, so I would have guessed you'ld say that (without actually knowing).

What's it got to do with your proposal to solve chess? Aren't you planning to use some version of Stockfish?
It has only the Laws of Chess i.e. axioms as input and performs only boolean operations i.e. logic to acquire knowledge i.e. theorems.

Precisely the same can be said of the program that produces FIDE's online version of its laws. It doesn't acquire any knowledge or state any theorems. With the current level of AI programs can'r really be said to know anything at all. You get to know what the program's algorithm produces; nothing more.

This paper ranks the first moves in figures 5 and 31:
d4 > e4 > Nf3 > c4 > e3 > g3 > Nc3 > c3 > b3 > a3 >
h3 > d3 > a4 > f4 > b4 > Nh3 > h4 > Na3 > f3 > g4.

Whoopidoo! I gave you my ranking earlier in the thread.

Once black has one path (there may exist several) to the 7-men endgame table base draw against the 4 best moves that oppose most to the draw,

There are only three possible outcomes. No such thing as opposing more.
then it is trivial to find such path to a draw or even a win for the 16 worst moves.

It might be trivial, but you haven't ventured to show how you can do it against SF15 from 1.e4 e5 2.Ba6. (Not that I think SF15 would manage it either against perfect play.)
You could object it is not complete, but you cannot object it is not valid.

The fact that it's not complete means it's not a valid solution.

In general a chess engine cannot correctly evaluate a chess position,
only the 7-men endgame table base can.

However, some positions with > 7 men are clear wins or draws and need no further calculation.

If you have a big red telephone to the Gent upstairs that is. The rest of us would need a solution.

1 e4 e5 2 Ba6? is an example of a clear loss for white. Stockfish says -8.1.
A full bishop up with all the rest being equal is more than a pawn up and is thus enough to win.
I have even demonstrated it is a forced checkmate in 72.

Or sometimes various other figures or a mate in 2 for Black as I demonstrated using the same method. (You are joking aren't you? It's not always clear.)

The final position of this game is an example of a clear draw with 12 men.
https://www.iccf.com/game?id=1164259 

I tried it with two engines in Arena. Are you sure your big red telephone took this line into account?

 

tygxc

@7504

"You're not even planning a solution according to any sensible definition."
++ Weakly solving just as sone for Checkers:
calculating from the opening to a 7-men endgame table base draw.

"Problem is you don't seem to have any."
++ you < me < grandmaster
I do not qualify as one of the 3 good assistants, which would require (ICCF)(grand)masters.

"What's it got to do with your proposal to solve chess? Aren't you planning to use some version of Stockfish?" ++ Yes, Stockfish running on 3 cloud engines with 3 grandmasters using knowledge to launch and occasionally terminate calculations.

"With the current level of AI programs can'r really be said to know anything at all."
++ The peer-reviewed paper has knowledge in its title, not guess, think, or belief.

"I gave you my ranking earlier in the thread."
++ You are not qualified. Otherwise publish your findings in a peer-reviewed paper.

"There are only three possible outcomes. No such thing as opposing more."
++ There is a thing as opposing more.
If say 1 e4 leaves only a series of only moves to secure the draw, and if 1 a4 allows say 6 different moves to secure the draw, then 1 e4 opposes more to the draw than 1 a4.

"how you can do against SF15 from 1.e4 e5 2.Ba6."
++ How I, or you, or Carlsen do against SF15 has nothing to do with solving Chess.

"The fact that it's not complete means it's not a valid solution."
++ Incomplete is not the same as invalid. After the good moves are proven unable to win for white, then it is trivial to repeat the same procedure for the bad moves.

"The rest of us would need a solution."
++ Some patzers may not understand that 1 e4 e5 2 Ba6? loses.

"I tried it with two engines in Arena" ++ Two bad engines... That position cannot be lost.

MARattigan
tygxc wrote:

@7504

"You're not even planning a solution according to any sensible definition."
++ Weakly solving just as sone for Checkers:
calculating from the opening to a 7-men endgame table base draw.

You've already claimed Checkers wasn't solved because not all openings were included in the solution. Whether or not that was the case you're planning to not solve chess for exactly the same reason (among others).

"Problem is you don't seem to have any."
++ you < me < grandmaster < SF ⋘ perfect. 
I do not qualify as one of the 3 good assistants, which would require (ICCF)(grand)masters.

You'ld be better just running three copies of SF on a desktop. Unless you're willing to wait for them to run SF for 5 days before adjudicating it would do just as well. Even if you're willing to wait 5 days every time, you're not guaranteed any improvement.

Definitely cheaper.

[Reinserted for context: The peer-reviewed paper 'Acquisition of Chess Knowledge in AlphaZero' has 'knowledge' in its title. It leads to things we know, not things we guess, believe, or think.]

"What's it got to do with your proposal to solve chess? Aren't you planning to use some version of Stockfish?" ++ Yes, Stockfish running on 3 cloud engines with 3 grandmasters using knowledge to launch and occasionally terminate calculations.

None of which are AlphaZero as far as I can see. So again, what's it got to do with your proposal to solve chess? 

"With the current level of AI programs can'r really be said to know anything at all."
++ The peer-reviewed paper has knowledge in its title, not guess, think, or belief.

Oh sorry. I didn't notice that. Of course that means AZ is sentient and knows what you say it knows. Has to be true if it's peer reviewed.

"I gave you my ranking earlier in the thread."
++ You are not qualified. Otherwise publish your findings in a peer-reviewed paper.

"There are only three possible outcomes. No such thing as opposing more."
++ There is a thing as opposing more.
If say 1 e4 leaves only a series of only moves to secure the draw, and if 1 a4 allows say 6 different moves to secure the draw, then 1 e4 opposes more to the draw than 1 a4.

Absolutely not in terms of perfect play.

"how you can do against SF15 from 1.e4 e5 2.Ba6."
++ How I, or you, or Carlsen do against SF15 has nothing to do with solving Chess.

Neither have your proposals. In particular your big red telephone is not a valid logical method.

"The fact that it's not complete means it's not a valid solution."
++ Incomplete is not the same as invalid. After the good moves are proven unable to win for white, then it is trivial to repeat the same procedure for the bad moves.

How can you say it's trivial when you can't do it?

And nobody knows what most of the good and bad moves are until someone (competent) manages to produce a solution.

"The rest of us would need a solution."
++ Some patzers may not understand that 1 e4 e5 2 Ba6? loses.

No it doesn't. Not even with Stockfish as White. Try it.

If you can't do it, you're one of the patzers. You don't understand things you can't do. (Doesn't apply just to game theory.)

"I tried it with two engines in Arena" ++ Two bad engines... That position cannot be lost.

Your big red telephone better than both, is it? Doesn't auger well for your project because one of them was SF15 which I think you're planning to use.

In any case you'ld consistently lose against either, so I think we can confidently dismiss your assertion that the position is a clear draw as just so much more BS. 

 

ADuelingBanjo
Every time I look at this thread one thing comes to mind :

🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓🤓
DiogenesDue
Optimissed wrote:

I would remind you that it's almost always you who brings up the subject of IQ. It's your obsession and not mine. It's also a bit of a far stretch to equate discrepancies regarding a few findings in a subject with derision for the entire subject; and it really shows how you think. It shows that you make things up to deliberately attempt to falsely show others in a bad light.

Thinking about what you were saying yesterday, I would say that the amount of hostility you display very often in arguments you cause with very many people indicates strongly that to have that amount of anger on tap, so to speak, you must have a sort of reservoir of anger in you.

That indicates that you have underlying anger against yourself, so what causes it? Why is it that it's like a button is pressed, especially with regard to some moral issues or issues that you see as moral? And you become not only unreasonable, but hostile and you deliberately distort just about anything, in order to try to show others in a bad light. I mentioned before what others tend to think of you and I would say it's due to that. It's the deceit, the twisting and misrepresentation of other people's statements. I'm wondering what causes the degree of anger you have against yourself. Maybe I could try to guess. Quite a lot of people have already tried to guess what it is, of course. There's one theme that consistently comes out and I have to say that my mind is also drawn to that explanation.

Always the call to some nonexistent silent majority and the vague innuendo.  I laid out 4 examples of academic areas you have trashed repeatedly over time to back up my observations, and you laid out...nothing.  There's never a lick of substance in anything you are pushing.

DiogenesDue
pds314 wrote:

I come back to this thread 995 new posts later and suddenly it's about the early settlers in America, the British empire, and the difference between nationalism, patriotism, and national or ethnic chauvinism? How did this happen?

Isn't this about whether chess will be solved and debating whether won, drawn, or lost in chess means in a mathematically absolute sense or in an "overwhelming majority of conventionally good lines lead that way" sense?

You are laboring under some idea that this thread is a back and forth discussion.  It's not.  It's one crackpot who has already been refuted by everybody else, and one pot-stirrer who doesn't know diddly but likes to pretend he's the only one with the real answers.

Occasionally a new poster comes in and also refutes the crackpot, by making the same arguments already put forth dozens of times.  It is helpful, in terms of volume of dissent.  The only reason cogent posters are still here is to make sure that the crackpot's narrative does not get any traction.  There are better threads on this topic that don't run on forever...

MARattigan

Another whopper!

Tjplayz76

ok

Tjplayz76
Optimissed wrote:
MARattigan wrote:

Another whopper!

^^ Another troll. Probably with dementia.mm

 

mpaetz
Optimissed wrote:

Sorry, I forgot that you're perfect. My mistake.

I'll tell you what though. For perfect people, you don't half defend yourselves at the slightest hint of criticism. I suppose that's why you're such a great nation.

     I certainly do not subscribe to the all-too-common idiocy of defending one's own nation as a paragon of virtues, a trait hardly limited to the United States. Personally, I vehemently disagree with the "America is a shining golden beacon inspiring the rest of the world" claptrap we hear too often.

     There are areas where every society is better, and worse, than many others. Knee-jerk jumping to the defense of the overall "obvious" superiority of one's own nation and discounting any criticism thereof is a confession of deliberate ignorance.

DiogenesDue
Optimissed wrote:

tygxc's only real mistake is to insist on the Sveshnikov five year plan. However, others are equally mistaken: Elroch because he insists it isn't known that 1. e4 e5 2. Ba6 loses. In a way, that's crazier than tygxc's assertion. MAR for continually bringing up the question of rules of chess, which is irrelevant when it can't be solved anyway. Then we have the crackpot who picks fights with everyone and thinks he knows it all. That's you. And the crackpot who continues to treat you with respect even though you've proved time and time again that there's no way you deserve it. That's me.

Your main superpower is to contort anything that occurs into part of a delusional narrative that keeps your ego safe.  Joseph Campbell and the monomyth has nothing on you.

llama36
Optimissed wrote:

treat you with respect even though you've proved time and time again that there's no way you deserve it.

MARattigan

Talking to yourself is a sign of dementia, @Optimissed.

MEGACHE3SE

Tygxc it takes a lot more than that to solve chess.  Alpha go has cost over 35 million dollars, and people  have put wayyy more into chess solving.  We don’t yet have a pruning algorithm able to reduce the chess calculations to a reasonable number, whereas there was one for checkers

DiogenesDue
Optimissed wrote:

As for you, I'm far from the only person to think you're mentally ill. Everything you say seems to have most relevance if it's seen in relation to yourself. Take more of your tablets. If Chess.com had a proper blocking facility I and hundreds of others would be using it.

More of the same...

Funny how these "hundreds" depend on you to speak for them.  I don't take tablets.  That's the narrative I was talking about.  It is not feasible for you to think that I am perfectly sane and that my observations might be accurate...you're a bit delicate that way.

DiogenesDue
Optimissed wrote:

I've seen a lot of such comments, directed at you, recently. Also in the past week to my knowledge you've deliberately picked three or four nasty fights with people other than me and only in threads I'm aware of, because I certainly don't follow you around. There's no question about whether you bully people and if, as you claim, you're sane, then that means you must do it deliberately. That makes you a troll in itself. Given that you habitually distort the truth, invent things about others and misrepresent them as a matter of course, as well as the passive aggression that you habitually employ, it means you're quite a nasty troll. I'm just saying what I think. It doesn't mean a lot to me. It probably means more to you.

You keep saying stuff like this, but when called upon to back it up, you never can.  It's a pretty tired refrain at this point.

pds314

Suppose that we have a unit which measures whether a games' position is a win, loss, or draw. Anything above 1 is a tablebase win by definition, anything below -1 is a tablebase loss by definition. Anything in between is a tablebase draw by definition.

If both players play the best moves, the evaluation stays the same.

If one player is an Oracle who plays the best moves but the other blunders slightly, the score should drift more and more in favor of the tablebase player. But possibly not enough to convert the advantage to a win.

Since we know that this evaluation doesn't change with optimal play, the conclusion can only be that it changes with suboptimal play in the direction of the opponent. Ergo, if a position is +25 centiwins, and you make a slight inaccuracy, it could be +15 centiwins, or -30, or -200, but making best moves keeps it at +25 centiwins.

If we assume you can always blunder the same number of centiwins and it's equally likely (not true but just for the models' sake), and that a chess game is always exactly 100 moves, we can model a game as a sort of random walk and its win/loss/draw state as the evaluation position after 100 moves. If the chance of a given size inaccuracy up to a certain maximum is equal, the distribution of deviations after 2 half moves will be triangular. Since with a triangular distribution the median deviation after a full move is ~29.3% the maximum blunder a player would make, and the mean is 33.3%, we shall assume that the random walk has a scale 1/3rd of the maximum blunder the player would reasonably make on that move.

Observation 1: the random walk scale in centiwins per move is not a free value. If you want a given draw rate between players of equal skill, the innacuracies need to average a certain size. For example, if we assume a random walk size of 10 centiwins per move, then after 100 moves, the average random walk will have deviated 1.0 wins from the starting position in either direction. 50% will deviate less than that. We might guess that something like 7-8 cW/move is top level human play.

2. White's starting advantage is not a free value either. To get realistic win/draw/loss numbers, White's starting advantage should be less than a win but not 0 in this model. So for example an advantage of 0.33 will produce a distribution where white wins way more than black at high level but draws dominate, since black has twice as far to go as white. A value of 0.5 might make white win TOO often to match experimental results.

3. It is possible, given the assumptions here, to calculate the winrate of the Oracle against strong but imperfect players. If a players's maximum blunder is 22 cW, then they will lose on average 11 cW every move against an oracle. The odds that a random walk with a drift that size wouldn't go at least 150 cW from the origin point after 100 moves are vanishingly small.

To actually have a 50% chance to draw an Oracle as white, the average cW/move needs to be down to whatever (1+white's advantage) / 100, which means the maximum is twice that and the average deviation playing against itself is 1/3rd the maximum. Given this is the case, any engine with a good chance of drawing an Oracle will need circa 1.5 cW of inaccuracy on average and 1 cW of inaccuracy per move  in self-play games. One conclusion here is that any engine that sometimes loses against itself is still very far from having a chance against an oracle.

Note that I'm assuming here that the oracle plays well, trying to create positions where there are many serious blunders the opponent could make, andas few drawing lines as possible, rather than playing the minimum to preserve the draw. An oracle that will happily blunder as long as the blunder preserves a draw will lock itself at like -90 cW unless the opponent makes a 200 cW blunder.

One other result here is that the drift will just be the difference in mean cW loss. Thus, a player who averages 12 cW loss should convincingly beat one who averages 16 even with the 100 cW average deviation by the end of the game. This represents hundreds of ELO difference.

Importantly, a low rated player with 60 cW loss will be rated even more convincingly winning against a player with 80 cW loss. 2000 cW of drift with an average deviation of 500 cW requires 3.7 average deviations of drift to get a draw instead of 2.6 or whatever. The ELO difference is larger even if the difference in blunder size is the same.

All this sounds like it should produce exactly the sort of results txgxc is saying. That the game theoretic win margin and the 50% winrate margin for games of any and equal skill level are one and the same.

HOWEVER..

Anyone who's ever played more than a couple games knows this isn't perfectly representative as a statistical model of chess for a few reasons:

1. Chess does not end at 100 moves. There are moves that bring it closer and further to ending and it's naive to think nobody is trying to alter the game length deliberately for strategic reasons. E.G. Not trading down material.

2. It is widely considered true and backed up by some observation that blunder size is neither linearly distributed nor insensitive to aspects of the position. Briefly, in simpler positions simpler thought processes are sufficient to avoid serious blunders. In complex positions, complex thought processes are required to avoid serious blunders. It is usually better to try to force complex positions with objectives you understand but your opponent does not against weak opponents, and force sharp, chaotic positions with objectives both sides understand against stronger opponents.

3. It is uncertain what the effect of advantage is on blunder size. If having advantage significantly decreases mean blunder size, then it is likely that games with imperfect play will spiral out of control even with non-winning advantages, and this would cause us to think a winning advantage was smaller than it really is if we don't account for it. E.G. Thinking a pawn advantage in the opening is winning when you actually need a piece to guarantee a tablebase win. If advantage significantly increases blunder size for the advantaged player, then it is instead likely that people usually gain completely winning advantages and throw them away in real games. In which case, thinking you need a pawn to win when you just need 2 tempi in the opening or something would be the expected result.

If there is any data on blunder severity vs advantage in equally rated games that would likely give a significant clue as to how big a forcibly winning advantage really is (especially if blunder severity isn't correlated with advantage when advantage isn't enormous).

llama36
pds314 wrote:

If we assume you can always blunder the same number of centiwins and it's equally likely (not true but just for the models' sake), and that a chess game is always exactly 100 moves, we can model a game as a sort of random walk

A random walk that only goes in one direction? Because remember, you said...

 

pds314 wrote:

one player is an Oracle who plays the best moves but the other blunders slightly, the score should drift more and more in favor of the tablebase player.

I realize this is fine when you're talking about two imperfect players, but you seem to keep the same setup when talking about oracle vs imperfect when you say e.g.

 

pds314 wrote:

To actually have a 50% chance to draw an Oracle as white, the average cW/move needs to be down to whatever (1+white's advantage) / 100, which means the maximum is twice that and the average deviation playing against itself is 1/3rd the maximum.

Why wouldn't the maximum average blunder rate simply be 1+white's advantage / 100?

 

pds314 wrote:

One other result here is that the drift will just be the difference in mean cW loss. Thus, a player who averages 12 cW loss should convincingly beat one who averages 16 even with the 100 cW average deviation by the end of the game. This represents hundreds of ELO difference.

I know it's just a model, but this feels too far from reality. Between two imperfect players cW loss is just regular centipawn loss... and in practice we know that someone with a much higher cp loss can win since it only takes 1 significant mistake to lose a game. For example if I lose a pawn in the middlegame which eventually goes into a lost endgame.

Also centipawn loss is based on engine evaluations which naturally inflate over time. To use that example again, let's say I win a pawn and the engine thinks it's 0.8 in my favor, but in reality it's win. Let's imagine the game continues for 50 perfect moves, and now the eval is +5 in my favor, at which point I simplify the position with trades to reduce counterplay... engines frequently count such practical measures as bad and that would make my centipawn loss higher even though I was winning the entire game.

It's an interesting thought experiment but mixing imperfect engine evals and incomplete information (such as centipawn loss and assuming chess is a draw and a tempo is worth 1/3rd of a pawn) with ideas like a perfect player and game theoretic values seems incorrect.