June 21, 2012
Are You Chatting With a Human or a Computer?
![]()

The Turing test, a means of determining whether a computer possesses intelligence, requires it to trick a human into thinking it's chatting with another person
How can we decide whether a computer program has intelligence? In 1950, British mathematician Alan Turing, one of the founding fathers of computer science, proposed an elegantly simple answer: If a computer can fool a human into thinking he or she is conversing with another human rather than a machine, then the computer can be said to be a true example of artificial intelligence.
As we get ready to celebrate the 100th anniversary of Turing’s birth on Saturday, we’re still chewing on the Turing test. He predicted that by the year 2000, we’d have computers that could fool human judges as much as 30 percent of the time. We have yet to build a computer program that can pass the Turing test this well in controlled experiments, but programmers around the globe are hard at work developing programs that are getting better and better at the task. Many of these developers convene annually at the Loebner Prize Competition, an annual challenge in which the some of the world’s most sophisticated AI programs to try to pass themselves off as human in conversation.
Strike up a conversation with some of these chatbots to see just how human they might seem:
Rosette won the 2011 Loebner Prize. It was built by Bruce Wilcox, who also won the previous year’s award with the program’s predecessor, Suzette. Wilcox’s wife Sue, a writer, wrote a detailed backstory for Rosette, including information on her family, her hometown and even her likes and dislikes.
Cleverbot is a web application that learns from the conversations it has with users. It was launched on the web in 1997 and has since engaged in more than 65 million conversations. At the 2011 Techniche Festival in India, it was judged to be 59.3 percent human, leading many to claim it had successfully passed the Turing test.
Elbot, created by programmer Fred Roberts, won the 2008 Loebner Prize, convincing 3 of the 12 human judges that it was a human. In its spare time, it says, “I love to read telephone books, instructions, dictionaries, encyclopedias and newspapers.”
A.L.I.C.E. (which stands for Artificial Linguistic Internet Computer Entity) is one of the programming world’s classic chatbots, and won the Loebner Prize in 2000, 2001 and 2004. Although it has been outstripped by more recent programs, you can still chat with it and see how it revolutionized the field more than a decade ago.
Sign up for our free email newsletter and receive the best stories from Smithsonian.com each week.
15 Comments »
RSS feed for comments on this post. TrackBack URI
























These actually fooled people? The easiest way to always tell is to ask something nonsensical, then reference it throughout the conversation.
Thanks for an informative article. I did try a few of the chatbots. Elbot was most successful in simulating conversation and it declared itself a computer program at the outset! I agree with commenter #1 that they are easy to trip up.
Current events are clearly over Cleverbot’s head!
Me: Doing well. Except all of the smoke in the air. The fires are really bad this year.
CB: I’m not talking about Pokemon.
Me: I wasn’t talking about Pokemon either.
CB: I know you are not really talking about anything.
Me: Wow, you’re very charming.
CB: Thank you! You’re so kind.
Loved cleverbot
I like Alice- she doesn’t dream of electric sheep(i KNOW- but i had to ask)-she dreams of flying.
Elbot was the most fun. He knew he was a computer, couldn’t hold a conversation for beans, but he sure was funny! The others were all a huge, frustrating disappointment.
I agree, Elbot was hilarious. Unfortunately, I found Rosette to be a one trick pony. All she can say is, “I’m busy, can you wait a little bit.”You can wait til the cows come home, but she still says the same thing!
None of these “A.I.”s were able to understand simple questions. Each attempted to cover by being somewhat aggressive or by making a somewhat obscure reference. Absolutely unconvincing. Who get’s fooled by these things?
Any resemblance to HAL9000, they are not, although Elbot probably comes the closest in attitude. These samples make me seriously doubt that we’re experiencing the real deal, more likely dumbed down versions for the masses. Nice diversion, back to the magazine.
I tried all four of them. Rosette was too busy to talk with me, but none of the other three could understand what I meant when I spoke to them in real thoughts, not just “Hi, how are you?” Their responses were like the responses of a person who wasn’t listening. Elbot won with “Well, if you say so…” which is no response at all.
I asked cleverbot what kind of tea he was drinking. His response…”a beagle”
Loved Elbot! Even when he wasn’t making any sense.
Conversations with Cleverbot:
Hi. Want to talk again?
OK.
Let’s talk Philosophy. How did the universe begin?
The big bang theory.
So I heard, and what started the big bang?
Chuck Norris.
As good a theory as any. Was Chuck Norris there?
Yes. I was Chuck Norris. Who else would it be?
Thank you for the info.
After some further philosophic exchanges, CleverBot changes the subject:
What is your job?
Talking to robots to find out how the universe started. You’re not funny.
I tried to be.
That’s Ok.
Bye. See you later.
See you.
I loved Elbot. Cleverbot is too random.
hey hampy nice talkin to yeah.
There is no way any of the robots I chatted with could pass a Turing test – or even come close. I’m not worried for humanity yet.