Forums

the Turing test

Sort:
raul72

The Turing test is a test of a machine's ability to exhibit intelligent behavior. I was wondering could a strong player determine chess skill (approx. elo of humans) by talking and asking questions to someone here on Chess.com?

I'm pretty sure this is possible but I dont know what questions you would ask and what would you talk about. I think the person may lie (permissible) and the questioner will have to overcome that problem.

I recall some time back a master was playing someone (on line) who claimed he was Fischer. The master asked Fischer "Do you know Armando Acevedo?" (an obscure Mexican player). The response was immediate: "Siegen 1970." Fischer had played Acevedo in the Siegen Chess Olympiad of 1970.

Do you think a novice 1200-1300 could convince a titled player he was 2000+ just by talking with him and answering questions intelligently but deceptively or would the master find him out in a very short period of time?

heinzie

"What is your FIDE rating" generally tends to yield interesting responses

waffllemaster
raul72 wrote:

The Turing test is a test of a machine's ability to exhibit intelligent behavior. I was wondering could a strong player determine chess skill (approx. elo of humans) by talking and asking questions to someone here on Chess.com?

I'm pretty sure this is possible but I dont know what questions you would ask and what would you talk about. I think the person may lie (permissible) and the questioner will have to overcome that problem.

I recall some time back a master was playing someone (on line) who claimed he was Fischer. The master asked Fischer "Do you know Armando Acevedo?" (an obscure Mexican player). The response was immediate: "Siegen 1970." Fischer had played Acevedo in the Siegen Chess Olympiad of 1970.

Do you think a novice 1200-1300 could convince a titled player he was 2000+ just by talking with him and answering questions intelligently but deceptively or would the master find him out in a very short period of time?


Interesting, I'm not sure.  Of course the 1200-1300 rated player would have to practice their deceptive responses.

If the titled player had the mindset that the mystery player was not an expert+ until proven otherwise then I don't think so.

What kinds of questions would I ask the mystery player?  That's a good one too.  Likely open ended questions about general chess ideas such as how and when is calculation important, talk about how pawns are related to strategy, walk me through a pet opening variation etc.  Technical or trivia questions would obviously be a poor judge of strength as masters are over 2000 and have holes in their understanding; meaning the mystery player would have deniability as well as a chance to google some basic information.

raul72
heinzie wrote:

"What is your FIDE rating" generally tends to yield interesting responses


OK, I'll play the novice---My fide rating is 2000. Next question.

heinzie

I thought this would be pretending to be of GM alloy but OK I'll play the inquisitor

No, your inactive USCF rating is 1800ish

raul72
waffllemaster wrote:
raul72 wrote:

The Turing test is a test of a machine's ability to exhibit intelligent behavior. I was wondering could a strong player determine chess skill (approx. elo of humans) by talking and asking questions to someone here on Chess.com?

I'm pretty sure this is possible but I dont know what questions you would ask and what would you talk about. I think the person may lie (permissible) and the questioner will have to overcome that problem.

I recall some time back a master was playing someone (on line) who claimed he was Fischer. The master asked Fischer "Do you know Armando Acevedo?" (an obscure Mexican player). The response was immediate: "Siegen 1970." Fischer had played Acevedo in the Siegen Chess Olympiad of 1970.

Do you think a novice 1200-1300 could convince a titled player he was 2000+ just by talking with him and answering questions intelligently but deceptively or would the master find him out in a very short period of time?


Interesting, I'm not sure. Of course the 1200-1300 rated player would have to practice their deceptive responses.

If the titled player had the mindset that the mystery player was not an expert+ until proven otherwise then I don't think so.

What kinds of questions would I ask the mystery player? That's a good one too. Likely open ended questions about general chess ideas such as how and when is calculation important, talk about how pawns are related to strategy, walk me through a pet opening variation etc. Technical or trivia questions would obviously be a poor judge of strength as masters are over 2000 and have holes in their understanding; meaning the mystery player would have deniability as well as a chance to google some basic information.


"general chess ideas such as how and when is calculation important, talk about how pawns are related to strategy, walk me through a pet opening variation etc."

How is calculation important? Chess is calculation! When is calculation important? One is always calculating in chess! Walk me through a pet opening. I'm not really into openings. I dont like to study openings---I would say my general knowledge of openings gets me into the middle game with a fighting chance. Many of the greats were not opening experts. Capablanca, Reshevsky etc., etc. How are pawns related to strategy? Pawns are the soul of chess. Take care of your pawns and they will take care of you.

I think an intelligent novice might fake his way through a Turing like exam.

raul72
heinzie wrote:

I thought this would be pretending to be of GM alloy but OK I'll play the inquisitor

No, your inactive USCF rating is 1800ish


With just one question you think you know my uscf rating. Nobody is that good. You must examine the subject and then base your decisions on the questions and answers. Be a little scientific!

heinzie

It was my next remark/question - trying to lure you into an emotional response

waffllemaster
raul72 wrote:

"general chess ideas such as how and when is calculation important, talk about how pawns are related to strategy, walk me through a pet opening variation etc."

How is calculation important? Chess is calculation! When is calculation important? One is always calculating in chess! Walk me through a pet opening. I'm not really into openings. I dont like to study openings---I would say my general knowledge of openings gets me into the middle game with a fighting chance. Many of the greats were not opening experts. Capablanca, Reshevsky etc., etc. How are pawns related to strategy? Pawns are the soul of chess. Take care of your pawns and they will take care of you.

I think an intelligent novice might fake his way through a Turing like exam.


This is the response I was looking for to tell me the player is not titled.  But I would probably ask a follow up just to be sure.

Fair enough.  That's why I have to ask multiple questions :)

Tell me HOW pawns are related to strategy.  Words or general examples are fine, a quote from philidor isn't enough :)

Wou_Rem

The real question is, for how long?
It really depends on the skill of the one who is making the deception.
I have made people believe I was a programmer and a golfer by only knowing a few terms from programming and golving. It was a fun test.

The key is to avoid specific questions. If  someone were to ask you specific questions you would ofcourse be uncoverd. Simply because you are unfamiliar with the terms. In a conversation this is quite easy, an interrogation is a whole different story.

waffllemaster

One problem is a real person has an excuse for "stupid" conversation during a turing test... maybe they just aren't that interesting.  Maybe the like to make vague comments about today's weather or about their lunch which a computer can easily imitate.

The problem with faking chess skill for a few minutes in a conversation is you can't be vague forever... and because 2000+ players are in the top % of players the person asking is likely to assume the mystery player is rated under that until proven otherwise.

Maybe best to change the subject while throwing in a tid bit about a top level tourney (as if you follow the news) or a bit of chess history about a world champion.   I think that's your best bet although as an interrogator myself I woudln't mistake knowledge of chess history or current events for skill Tongue out

raul72
Wouter_Remmerswaal wrote:

The real question is, for how long?
It really depends on the skill of the one who is making the deception.
I have made people believe I was a programmer and a golfer by only knowing a few terms from programming and golving. It was a fun test.

The key is to avoid specific questions. If someone were to ask you specific questions you would ofcourse be uncoverd. Simply because you are unfamiliar with the terms. In a conversation this is quite easy, an interrogation is a whole different story.


What kind of specific chess questions would uncover you---give us some examples.

raul72
waffllemaster wrote:
raul72 wrote:

"general chess ideas such as how and when is calculation important, talk about how pawns are related to strategy, walk me through a pet opening variation etc."

How is calculation important? Chess is calculation! When is calculation important? One is always calculating in chess! Walk me through a pet opening. I'm not really into openings. I dont like to study openings---I would say my general knowledge of openings gets me into the middle game with a fighting chance. Many of the greats were not opening experts. Capablanca, Reshevsky etc., etc. How are pawns related to strategy? Pawns are the soul of chess. Take care of your pawns and they will take care of you.

I think an intelligent novice might fake his way through a Turing like exam.


This is the response I was looking for to tell me the player is not titled. But I would probably ask a follow up just to be sure.

Fair enough. That's why I have to ask multiple questions :)

Tell me HOW pawns are related to strategy. Words or general examples are fine, a quote from philidor isn't enough :)


How about this---I may not be able to define it, but I'll know a good pawn move when I see it! Or, once you move a pawn forward you better know what you're doing because you cant move it back. Or, pawns often become objects of attack so avoid weakening your pawn position---no isolated pawns, backward pawns, doubled pawns, Or, pawns form the skeleton of your position so make sure its a healthy, pawn skeleton. Or, can you tell a girl skeleton from a boy skeleton?

Yes I can---but I can do it better when they're upholstered! looooooooooo

waffllemaster

Pretty good :)  A joke is nice to work in there.

raul72

Kasparov was fooled 14 yrs ago when he played Deeper Blue. He claimed the machine was making un-machine like moves (human moves). In dog years, or rather in machine years --- 1997 is a a lifetime ago.

If the machine could fool Kasparov a lifetime ago, what do you think it could do now! Lets ask some of the titled players here a Chess.com if they could tell they are playing a machine and how would they do that.

The master is in one room and his opponent is in another room. The master must decide if he is playing a machine or a human. If the master decides correctly he is given $100,000. If he decides incorrectly he must fork over $50,000 simoleons and be tasered into painful, unconsciousness---the most painful experience of a lifetime.

Well masters---what say you? Could you pass that Turing test?