The History of Artificial Intelligence: The Turing Test

In his 1950’s work Computing Machinery and Intelligence, Alan Turing (1912–1954), who is considered by many the father of Artificial Intelligence, laid out the following question:

Can machines think?

This question, despite its short length and old origin, still remains a frequent source of discussion, navigating the frontier between technology, philosophy, neuroscience and theology.

However, more than half a century ago Turing proposed an indirect way to answer it: Through the famous Turing Test.

Turing believed that for us to answer this question without ambiguity, the question itself must be rephrased, specifying or replacing the meaning of ‘think’ and ‘machines’.

Lets first see how we can smooth the ‘think’ out of the equation. Turing proposed to do this by first modifying the question from “Can Machines Think?” to:

“Can a machine do what we as thinking entities can do?”

In other words, can a machine mimic or imitate a person? The answer to this question lies within The Imitation Game.

The Imitation Game

The new form of this problem – answering the previous question- is formulated in the following terms.

Imagine we have a man (A), a woman (B), and a neutral interrogator (C). Each of these subjects is in a separate locked room with no windows or form of visual connection, and only a screen and a keyboard through which C can communicate and interact with A and B.

The goal of the game is for C — the interrogator — to discover who is the male (A) and who is the female (B). He does this by asking questions to each of them, like for example sending a message to A (without knowing that he is the man) saying ‘What is the length of your hair?’.

The goal of A, in this case, is to make the interrogator fail, that is, fool him into thinking that he is the female. Because of this, the answer to the previous question could be something like ‘My hair is singled, and the longest strands are about nine inches long’, or something even more ambiguous.

You might be wondering what all of this has to do with computers and machine-intelligence. Let’s ask the real relevant question now: what will happen when a machine takes the role of A in this game?

This is the essence of the Turing Test: an interrogator has a conversation through the aforementioned method (screen and keyboard) with a certain entity, which can either be a human or a machine. This conversation is of limited duration in time, and is completely open.

If after this conversation the interrogator is not able to tell if the entity it was interacting with is a machine or a human, or even better, says it certainly was a human, and it turns out such entity was actually a machine, then this machine is said to have passed the Turing Test.

In the rest of the paper, Turing clarifies what for him is a machine, describes the characteristics of digital computers, and tries to dismantle certain critics to his answer to the question of whether machines can think or not.

This highlights the very little number of arguments that he has to defend his views, taking him to make a greater effort pointing out the weaknesses of the critics to his proposal than to defending it.

Before exiting the content of the paper to further discuss The Turing test, we will see how Turing takes some of the first approaches in conceptualising what will be one of the main drivers of Artificial Intelligence: Machine Learning.

Learning Machines

In the final sections of Computing Machinery and Intelligence Turing discusses how a machine with chances of being successful in playing the imitation game could be constructed.

He argues that to be able to code a program that fills up an even a moderate percentage of the storage capacity of the brain, it would take decades for an experienced group of programmers.

If we want to imitate an adult human mind, we should somehow replicate the process that has taken place in such a mind, which he says, is made up of three components:

  1. The initial state of the mind, at birth.
  2. The education to which this mind has been subjected.
  3. Experience different from education, as that coming from the environment, to which the mind has been exposed.

The goal here is to create a program that replicates the mind of a child, and then educate it — make it learn — in order for it to reach the characteristics of the adult brain.

He goes on to discuss the importance of punishment and reward as a part of the learning process — similar to what we know today as Reinforcement Learning — , but clarifies that this by itself is not enough, highlighting the need of learning through some sort of inference system from which reasoning and logical insights can be extracted — similar to supervised learning —.

Isn’t it delightful how by trying to answer the question of whether machines can think or not, we arrive at a glance of what would become the most disruptive and core field of Artificial Intelligence?

Discussion and evolution of The Turing Test

Summed up in a sentence, the Turing test basically approves the capabilities of a machine to think if this machine can be undistinguished from humans in a typed conversation for more than one third of the times (or some other established threshold) that the test is performed.

Some of the strongest critics to this attribution of intelligence to the machines who are victorious in the Turing test come from the narrow domain of intelligence that it challenges.

The test only evaluates textual communication capabilities — comprehension, and expression — . Is it enough for us to grant intelligence to the master of these two? Most critics tend to differ.

Many modern Artificial Intelligence applications, built using Machine Learning, succeed and perform with outstanding levels in very narrow domain specific tasks, even beating some of the best humans in these tasks, like with Deep Blue and chess or AlphaGo and the game of Go.

Does this mean that the machines understand the games? If they do not understand, can we say that they are intelligent?

One of the most famous critics of the Turing Test is what is known as The Chinese Room. Let’s take a look at it.

The Chinese Room

The Chinese room is a mental experiment, suggested in 1980 by John Searle, and popularised by the famous physicist Roger Penrose, that tries to challenge the validity of the Turing test, arguing that computation can not derive into ‘thinking’, or at least, not in the proposed manner.

The Chinese room tries to break the analogy between mind and computer arguing that while the former is utterly restricted to the manipulation of symbols, the mind possesses a semantic capacity to understand or be conscious of the meaning of such symbols.

The experiment goes like this: imagine that we have some sort of black-box machine or computer, to which we can feed different texts, and it responds with a very appropriate textual reply in the same language.

We have no idea what kind of process is going inside of it, however, this machine can hold a perfect conversation, so it passes the Turing test with ease.

The question that Searle asks is:

Does this machine understand Chinese?

Now, instead of this black-box, imagine that we have a person inside the computer, who has no idea of speaking Chinese, however, has at his or her disposal a large list of instructions and manuals which can be used to give perfect replies for the input texts. These instructions have rules like ‘if these symbols are included in the input text, reply this and this’.

This raises three more questions:

Does the person inside the room understand Chinese?

Do the manuals of instructions and books understand Chinese?

Does the whole system understand Chinese?

The Chinese room can pass the Turing test, as we have said. Does this mean it can think then? This is what the experiment tries to dismantle by defending that thinking and understanding should go hand by hand, and therefore a system that can pass the Turing Test is not doing anything similar to thinking if it is not understanding.

The Legacy of the Turing Test

To finish off, let’s explore some of the most recent versions of the Turing test, along with when and how it has been passed, and the conclusions from such experiments.

ELIZA

ELIZA was a conversational bot, developed in the MIT in 1966 by Joseph Weizenbaum, being one of the first programs capable of processing natural language. This program, to which we could chat through a messenger service, mimicked a psychologist, encouraging the person at the other end to talk more and more about their problems.

It used sentences like ‘I see’ or ‘tell me more about this’ (see the last line of the following conversation), and repeatedly bombarded the human at the other end with questions, like shown in the following interaction.

Person: Do you think I can use this computer tomorrow?
ELIZA: Why do you ask?
Person: I should make more on-line sales.
ELIZA: Why are you not sure?
Person: My potential clients have never seen a demonstration of this system.
ELIZA: That does mean much for you?
Person: Naturally
ELIZA: You seem very enthusiastic about it
Person: This is ridiculous
ELIZA: What do you mean this is ridiculous?
Person: Is there any reason for which I can not use the computer now?
ELIZA: Tell me more about your potential clients.

In this case, the person speaking to ELIZA was told before the interaction that he was speaking to another human, and after the conversation, he didn’t suspect he had been instead talking to a machine at all.

ELIZA worked using a dictionary or keyword approach, looking for specific words within the input sentence that if found would trigger a pre-made response, which was probably a question. If none of the keywords was found, a generic response was given. Nowadays, much more sophisticated systems exist.

The Loebner Prize

The Loebner Prize is a competition hosted every year since 1990. It has had many different hosting locations like MIT, Cambridge University or the Science Museum of London.

Its goal is to evaluate the state of the art of conversational machines aspiring to pass the Turing Test and to promote Artificial Intelligence and Natural Language Processing research.

The procedure for this competition is the same that would be used for a normal Turing test: 30 different judges sit with 2 screens each and have two separate conversations: one with a computer program and one with a real person.

The goal is that of being able to correctly asses which screen belongs to the machine and which belongs to the person. Judges have various interactions with machine/human counterparts, and at the end of the day, the artificial system that has been able to fool the judges with the highest percentage success is crowned victorious.

An improved version of ELIZA, known as the PC Therapist, won this competition on its first three editions.

Despite being able to somehow asses the Turing Test performance of State of the Art Artificial Intelligence systems, this competition has created some controversy regarding the role of the judges, the way these can be tricked by approaches like ELIZA’s or other sorts of mimics, and the short and sometimes whimsical conversations that take place between judges and machines.

One of the biggest criticisms of this trial is the following by Hayes and Ford in 1995:

“the imitation game conditions say nothing about the judge, but the success of the game depends crucially on how clever, knowledgeable and insightful the judge is”

Also, very few times have the competing systems come close to beating the 1/3 of fooled judges threshold that is acknowledged as the limit to accept that it has passed the Turing Test. We will finish the article by exploring one of the systems that has touched this threshold: Eugene.

Eugene

Eugene Goostman is a conversational chat-bot designed in 2001 that came second in the Loebner Price in 2005 and 2008. In 2012, in a distinct competition, it obtained the highest ever score of 29% of the judges being fooled, and coming very close to surpassing the Turing Test Threshold.

Eugene works by imitating a 13 year-old Ukrainian boy, with grammatical mistakes, the lack of knowledge that can only be attributed to a kid, and a very special form of speaking.

Again, we can see the trickery in these kinds of systems. They avoid facing a natural conversation and instead try to exploit the weaknesses of the test by imitating a very specific character, thus driving the conversation to narrow domains in which they can comfortably have a chat.

In 2014, with this strategy, Eugene passed the Turing test, fooling 33% of the judges it spoke to in an event organised to honor the 60th anniversary of Turing’s death. Let’s see a transcript of a conversation with Eugene.

Judge: what music do you like?

Eugene: I like Eminem — because he doesn’t have a thing to do with “polite-correctness”.

Judge: OMG i love eminem, he’s my favourite artist!

Eugene: I wonder what Eminem’s nick mean. I associate it only with a word “enema”. But he is a cool guy, I like his “The Real Slim Shady”.

Judge: i know what his nick name means, his real name is Marshall Mathers. From the initials M&M phynetically sounding like Eminem.

Eugene: Eminem is a famous crapper. No, raper… ripper… Yeah, I mean — rapper. I like his “Stan” and “The Real Slim Shady”.

Judge: I like “Hailies song”

Eugene: Interesting tastes. I like science fiction books, by the way. Where do you came from, by the way? Could you tell me about the place where you live?

Judge: Epsom, home of the derby. yourself?

Eugene: My guinea pig says that name Derby sounds very nice.

Judge: i shopuld talk with him sometime

Eugene: I think you should take some typing lessons. Or just type more accurately.

Judge: that’s very rude?

Eugene: Ummm… Frankly, I didn’t get your question:-(

Judge: “Ummm” isnt a word. i think you need typing lessons

Eugene: My thoughts are same. By the way, I still don’t know your specialty — or, possibly, I’ve missed it?

Conclusion

This article has explored the origin, nature, and evolution of the Turing test, one of the first arrows directed towards assessing the target of Artificial Intelligence.

I hope it has not only served you for the purpose of understanding the origins of AI, but that it has also raised several questions, leading to some sort of internal discussion.

If not, I will give you one last nudge, inciting you to answer the following question:

Can this test really be a proxy for answering the question of whether machines can think?

There are various other factors which should be considered when trying to answer this question, aside from the previously provided.

First, is it important to know whether one of the two entities which we are interacting with is a machine?

As we saw in the transcript of the conversation with Eliza, the human did not previously know that this was a chance, so for him it was unquestionably an interaction with a person.

Would this have changed if he knew that he could have either been speaking to a machine or to a human?

Secondly, should the time limitations or unrestricted character of the conversations be addressed in some way? Also, what should we do about the previously discussed problem with the judges?

All of these considerations can only further stress the last sentence written by A. Turing in Computing machinery and Intelligence:

We can only see a short distance ahead, but we can see plenty there needs to be done.


That is all!

If you liked this post then feel free to follow me on Twitter at @jaimezorno. Also, you can take a look at my other posts on Data Science and Machine Learning here. Have a good read!

If you want to learn more about Machine Learning and Artificial Intelligence follow me on Medium, and stay tuned for my next posts!

Until then, take care, and enjoy AI!

Thanks for reading!

Resources

  • Turing, A. M. (1950). Computing Machinery and Intelligence. Mind, 59, 433–460. The paper can be found here.
  • Source for the heading Image: Pexels.
  • Icons from Flaticon.
  • Alan Turing Cartoon from: favpng.

 

 

Original post: https://towardsdatascience.com/the-history-of-artificial-intelligence-the-turing-test-c1d6777d2970

70 comentários em “The History of Artificial Intelligence: The Turing Test

  1. Thanks for ones marvelous posting! I actually enjoyed reading it, you are a great author.I will make certain to
    bookmark your blog and may come back at some point. I want to encourage yourself to continue your great posts, have a nice morning!

  2. Spot on with this write-up, I really believe that this web
    site needs much more attention. I’ll probably be returning to read more,
    thanks for the advice!

  3. Greetings I am so grateful I found your website, I really found you by accident, while I was browsing on Digg for something else, Anyways I am here now and would just like to
    say cheers for a tremendous post and a all round entertaining blog (I also love the theme/design),
    I don’t have time to go through it all at the moment but I have
    book-marked it and also added in your RSS feeds, so when I
    have time I will be back to read more, Please do keep up the superb work.

  4. Thanks for some other informative web site. Where else may
    I get that type of info written in such an ideal
    means? I’ve a project that I’m simply now working on, and I’ve been at
    the glance out for such information.

  5. Hey! This is my first visit to your blog! We are a team of volunteers and starting a new initiative in a community in the same niche.
    Your blog provided us valuable information to work on. You have done a
    outstanding job!

  6. We are a group of volunteers and opening a new scheme
    in our community. Your site provided us with valuable info to work on. You
    have done an impressive job and our entire community will be thankful to you.

  7. Hello! I know this is kinda off topic however , I’d
    figured I’d ask. Would you be interested in trading links or maybe guest authoring a blog article or vice-versa?
    My blog discusses a lot of the same topics as yours and I believe
    we could greatly benefit from each other. If you are interested feel free to shoot me an e-mail.

    I look forward to hearing from you! Fantastic blog by the way!

  8. I am the proprietor of JustCBD company (justcbdstore.com) and I’m presently seeking to broaden my wholesale side of company. It would be great if anybody at targetdomain is able to provide some guidance ! I considered that the very best way to accomplish this would be to reach out to vape shops and cbd stores. I was really hoping if anybody at all could recommend a reputable web-site where I can buy Vape Shop B2B Mailing List I am currently looking at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the very best choice and would appreciate any assistance on this. Or would it be simpler for me to scrape my own leads? Ideas?

  9. I’m the co-founder of JustCBD Store company (justcbdstore.com) and am aiming to grow my wholesale side of business. It would be great if anybody at targetdomain give me some advice . I considered that the most effective way to do this would be to talk to vape companies and cbd retail stores. I was really hoping if anybody at all could suggest a qualified web site where I can buy CBD Shops B2B Companies I am presently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the best option and would appreciate any support on this. Or would it be easier for me to scrape my own leads? Suggestions?

  10. Today, I went to the beach front with my children. I found
    a sea shell and gave it to my 4 year old daughter and said “You can hear the ocean if you put this to your ear.” She placed the
    shell to her ear and screamed. There was a hermit crab inside and it pinched her ear.
    She never wants to go back! LoL I know this is totally off topic but I had to tell someone!

  11. Hi, I do think your site might be having internet browser compatibility issues. Whenever I look at your site in Safari, it looks fine however, if opening in IE, it has some overlapping issues. I just wanted to give you a quick heads up! Apart from that, great website!

  12. Right here is the right web site for everyone who really wants to find out about this topic. You understand so much its almost tough to argue with you (not that I really would want to…HaHa). You definitely put a fresh spin on a subject which has been discussed for ages. Excellent stuff, just wonderful!

  13. Hi! I’ve been following your site for a while now and finally got the courage
    to go ahead and give you a shout out from Houston Tx! Just wanted to say keep up the great
    job!

  14. Aw, this was a very good post. Finding the time and actual effort to produce a really good article… but what can I say… I put things off a lot and never seem to get anything done.

  15. Hi! I could have sworn I’ve been to this site before but after browsing through some of the articles I realized it’s new to me. Regardless, I’m certainly pleased I came across it and I’ll be book-marking it and checking back regularly!

  16. Right here is the right webpage for anybody who would like to understand this topic. You understand so much its almost tough to argue with you (not that I personally will need to…HaHa). You definitely put a brand new spin on a subject that’s been discussed for many years. Excellent stuff, just wonderful!

  17. I’m pretty pleased to find this web site. I need to to thank you for your time for this
    fantastic read!! I definitely liked every bit of it and i also have you saved as a favorite to see new information in your website.

  18. Hi, I do think your site could be having internet browser compatibility issues. When I take a look at your web site in Safari, it looks fine but when opening in Internet Explorer, it has some overlapping issues. I merely wanted to give you a quick heads up! Besides that, excellent blog!

  19. I’m amazed, I have to admit. Seldom do I come across a blog that’s equally educative and entertaining, and without a doubt, you’ve hit the nail on the head. The issue is something that not enough men and women are speaking intelligently about. Now i’m very happy that I found this in my search for something relating to this.

  20. Hello, i read your blog occasionally and i own a similar one and i was
    just wondering if you get a lot of spam comments? If
    so how do you stop it, any plugin or anything you can suggest?
    I get so much lately it’s driving me mad so any assistance is very
    much appreciated.

  21. I am extremely inspired together with your writing skills and
    also with the layout to your weblog. Is this a paid theme or did you customize it yourself?
    Either way stay up the nice quality writing, it’s rare to peer a nice blog like this one nowadays..

  22. Hi there! Quick question that’s entirely off topic. Do you know how to
    make your site mobile friendly? My weblog looks weird when browsing
    from my iphone4. I’m trying to find a theme or plugin that
    might be able to resolve this issue. If you
    have any suggestions, please share. Cheers!

  23. An impressive share! I have just forwarded this onto a coworker who was doing a little research on this. And he actually bought me lunch simply because I found it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanx for spending the time to discuss this topic here on your web site.

  24. Achieving your fitness goals does not have to require a certified personal trainer or an expensive gym membership, it’s not hard to exercise at home. It’s easy to go down a training and fitness rabbit hole, however, when you are looking for the best home exercise equipment to outfit your personal home gym.

  25. Fantastic blog! Do you have any helpful hints for aspiring
    writers? I’m hoping to start my own website soon but I’m a little lost on everything.
    Would you recommend starting with a free platform
    like WordPress or go for a paid option? There are so many options
    out there that I’m completely confused .. Any recommendations?

    Appreciate it! cheap flights 31muvXS

  26. Aw, this was an extremely good post. Taking a few minutes and actual effort to generate a great article… but what can I say… I procrastinate a whole lot and don’t seem to get anything done.

  27. After looking at a handful of the articles on your website, I truly like your way of writing a blog. I added it to my bookmark webpage list and will be checking back soon. Take a look at my web site as well and let me know how you feel.

  28. What you posted was actually very reasonable.
    However, think about this, suppose you were to write a awesome title?

    I am not saying your information isn’t solid, but suppose you added a headline to maybe get
    folk’s attention? I mean The History of Artificial Intelligence: The Turing Test – Adolfo Eliazàt – Artificial Intelligence – AI News is kinda boring.
    You ought to glance at Yahoo’s front page and see how they create
    news titles to get viewers to click. You
    might try adding a video or a picture or two to grab readers interested about what you’ve
    written. Just my opinion, it could bring your posts a little livelier.

  29. Nice post. I learn something totally new and challenging on websites I stumbleupon everyday. It will always be exciting to read through content from other authors and practice something from other sites.

  30. Hi, I think your blog might be having browser compatibility issues.
    When I look at your website in Firefox, it looks fine but when opening in Internet Explorer, it
    has some overlapping. I just wanted to give you a quick heads up!
    Other then that, fantastic blog!

  31. We’re a group of volunteers and opening a
    new scheme in our community. Your site provided us with valuable information to work on. You’ve done an impressive job and our whole
    community will be grateful to you.

  32. I blog quite often and I seriously appreciate your information. This article has really peaked my interest. I’m going to take a note of your website and keep checking for new details about once a week. I opted in for your RSS feed too.

  33. Howdy! This blog post could not be written any better! Looking at this article reminds me of my previous roommate! He continually kept preaching about this. I am going to forward this article to him. Fairly certain he’ll have a great read. Many thanks for sharing!

  34. I blog often and I truly appreciate your content. This article has really peaked my interest. I’m going to take a note of your website and keep checking for new details about once per week. I subscribed to your Feed too.

  35. I’m pretty pleased to uncover this website. I want to to thank you for your time for this particularly fantastic read!! I definitely loved every little bit of it and i also have you bookmarked to look at new stuff on your web site.

  36. You are so awesome! I don’t suppose I’ve truly read through a single thing like that before. So good to discover someone with some original thoughts on this topic. Seriously.. thank you for starting this up. This web site is something that’s needed on the web, someone with some originality!

  37. Having read this I believed it was really enlightening. I appreciate you taking the time and effort to put this content together. I once again find myself spending a significant amount of time both reading and commenting. But so what, it was still worth it!

  38. Hi, I do believe your web site may be having browser compatibility problems. When I take a look at your site in Safari, it looks fine however, if opening in I.E., it has some overlapping issues. I merely wanted to provide you with a quick heads up! Other than that, great site!

  39. I blog quite often and I truly thank you for your information. The article has really peaked my interest. I am going to book mark your blog and keep checking for new details about once a week. I opted in for your Feed as well.

  40. That is a great tip especially to those fresh to the blogosphere. Brief but very accurate info… Many thanks for sharing this one. A must read article!

Leave a Reply

Your email address will not be published. Required fields are marked *