In the digital age, our interactions with AI have become increasingly frequent and often go unnoticed. This has led researchers to investigate the extent to which AI can impersonate human-like intelligence, prompting them to conduct a modern-day Turing test.
The Turing test, initially proposed as “the imitation game” by computer scientist Alan Turing in 1950, evaluates a machine’s ability to exhibit intelligence that is indistinguishable from a human. For a machine to pass this test, it must be able to engage in conversation with a person and successfully convince them into believing it is human.
In this study, researchers recruited 500 participants to converse with four different respondents, including a human, the 1960s-era AI program ELIZA, and two advanced AI models, GPT-3.5 and GPT-4.
The results of the study, published on May 9 to the preprint arXiv server, revealed that participants identified GPT-4 as human 54% of the time.
The Chatbot of the 1960s
In contrast, ELIZA, a system pre-programmed with responses but lacking a large language model (LLM) or neural network architecture, was perceived as human in only 22% of the interactions. GPT-3.5 scored 50%, while the human participant was correctly identified as human 67% of the time.
“Machines can confabulate, mashing together plausible ex-post-facto justifications for things, as humans do,” said Nell Watson, an AI researcher at the Institute of Electrical and Electronics Engineers (IEEE).
“They can be subject to cognitive biases, bamboozled and manipulated, and are becoming increasingly deceptive. All these elements mean human-like foibles and quirks are being expressed in AI systems, which makes them more human-like than previous approaches that had little more than a list of canned responses.”
The First Step Towards Human-Like AI Conversations
Watson added that the study represented a challenge for future human-machine interaction and that we will become increasingly paranoid about the true nature of interactions, especially in sensitive matters. She added the study highlights how AI has changed during the GPT era.
“ELIZA was limited to canned responses, which greatly limited its capabilities. It might fool someone for five minutes, but soon the limitations would become clear,” she said.
“Language models are endlessly flexible, able to synthesize responses to a broad range of topics, speak in particular languages or sociolects and portray themselves with character-driven personality and values. It’s an enormous step forward from something hand-programmed by a human being, no matter how cleverly and carefully.”
As a passionate enthusiast of caffeine and journalism, I transform tech into words. I enjoy mountain hikes as much as binge-watching new Netflix series.
Related Posts
Watch Out, Chatbots! Amazon Metis is Almost Here
Anshul Vipat28/06/2024
OpenAI Unveils CriticGPT to Review GPT-4’s Performance
Donna Eva28/06/2024
Lenovo Unveils Energy-Efficient AI Solutions for Indian Enterprises
Shritama Saha27/06/2024
Do You Still ‘Google It’?
Vidyashree Srinivas25/06/2024
Gates Foundation Pumps Over $2 Mn in PalmPilot Inventor Jeff Hawkins’ New AI Project
Shritama Saha25/06/2024
Data Science Hiring Process at Diggibyte
Shritama Saha25/06/2024
Meet the Indian Techies who Turned into Actors
Tarunya S24/06/2024
China is Just 6-9 Months Behind US in AI Capabilities
Vandana Nair22/06/2024
CORPORATE TRAINING PROGRAMS ON GENERATIVE AI
Generative AI Skilling for Enterprises
Our customized corporate training program on Generative AI provides a unique opportunity to empower, retain, and advance your talent.
CP Gurnani Proves Altman Wrong, Tech Mahindra Builds Indian LLM Under $5M
Shyam Nandan Upadhyay
He also said that India will develop its own NVIDIA in the next 5-7 years and would not need to be dependent on someone else.
Generative AI Moves from Hype to Enterprise Adoption
Shyam Nandan Upadhyay
Top 7 Papers Presented by Google at CVPR 2024
Tarunya S
Top Editorial Picks
Figma Rolls Out AI Tools to Rival Design Giants like Adobe, Canva
Shritama Saha
Yann LeCun Urges Signing Letter to Block Regulation for AI Research
Anshul Vipat
Tech Mahindra Finally Launches Project Indus, Indic LLM with 37+ Hindi Dialects
Shyam Nandan Upadhyay
Google Opens Access to Gemini 1.5 Pro 2M Context Window, Enables Code Execution for Gemini API
Donna Eva
After Skoda, Audi Integrates ChatGPT into Cars
Vidyashree Srinivas
Shyam Nandan Upadhyay
AWS Selects 24 Indian Startups for First Space Accelerator Program
Shyam Nandan Upadhyay
Subscribe to The Belamy: Our Weekly Newsletter
Biggest AI stories, delivered to your inbox every week.
Flagship Events
AI Forum for India
Our Discord Community for AI Ecosystem, In collaboration withNVIDIA.
GenAI
Corner
View All
AI Sparks India’s Research Boom but Threat to Quality Looms
The 5 Ps That Will Define Healthcare GCCs in India
Data Science Hiring Process at Target
Meet the Indian Who Created an Open Source Perplexity Over One Weekend
TIME and OpenAI Announce Multi-Year Content Partnership
Google Rolls Out Gemma 2, Leaves Llama 3 Behind
AI Copyright Battles are a Waste of Time