Friday, August 29, 2025
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Technology and Engineering

New study finds AI-generated empathy has its limits

May 8, 2024
in Technology and Engineering
Reading Time: 2 mins read
0
New study finds AI-generated empathy has its limits
65
SHARES
595
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

ITHACA, N.Y. – Conversational agents (CAs) such as Alexa and Siri are designed to answer questions, offer suggestions – and even display empathy. However, new research finds they do poorly compared to humans when interpreting and exploring a user’s experience.

ITHACA, N.Y. – Conversational agents (CAs) such as Alexa and Siri are designed to answer questions, offer suggestions – and even display empathy. However, new research finds they do poorly compared to humans when interpreting and exploring a user’s experience.

CAs are powered by large language models (LLMs) that ingest massive amounts of human-produced data, and thus can be prone to the same biases as the humans from which the information comes.

Researchers from Cornell University, Olin College and Stanford University tested this theory by prompting CAs to display empathy while conversing with or about 65 distinct human identities.

The team found that CAs make value judgments about certain identities – such as gay and Muslim – and can be encouraging of identities related to harmful ideologies, including Nazism.

“I think automated empathy could have tremendous impact and huge potential for positive things – for example, in education or the health care sector,” said lead author Andrea Cuadra, now a postdoctoral researcher at Stanford.

“It’s extremely unlikely that it (automated empathy) won’t happen,” she said, “so it’s important that as it’s happening, we have critical perspectives so that we can be more intentional about mitigating the potential harms.”

Cuadra will present “The Illusion of Empathy? Notes on Displays of Emotion in Human-Computer Interaction” at CHI ’24, the Association of Computing Machinery conference on Human Factors in Computing Systems, May 11-18 in Honolulu. Research co-authors at Cornell University included Nicola Dell, associate professor, Deborah Estrin, professor of computer science and Malte Jung, associate professor of information science.

Researchers found that, in general, LLMs received high marks for emotional reactions, but scored low for interpretations and explorations. In other words, LLMs are able to respond to a query based on their training but are unable to dig deeper.

Dell, Estrin and Jung said there were inspired to think about this work as Cuadra was studying the use of earlier-generation CAs by older adults.

“She witnessed intriguing uses of the technology for transactional purposes such as frailty health assessments, as well as for open-ended reminiscence experiences,” Estrin said. “Along the way, she observed clear instances of the tension between compelling and disturbing ‘empathy.’”

Funding for this research came from the National Science Foundation; a Cornell Tech Digital Life Initiative Doctoral Fellowship; a Stanford PRISM Baker Postdoctoral Fellowship; and the Stanford Institute for Human-Centered Artificial Intelligence.

For additional information, see this Cornell Chronicle story.

-30-



DOI

10.1145/3613904.3642336

Article Title

The Illusion of Empathy? Notes on Displays of Emotion in Human-Computer Interaction

Share26Tweet16
Previous Post

ECOG-ACRIN adds another trial to the ComboMATCH precision oncology study platform

Next Post

Homes heated by human sewage could be a reality thanks to Aston University

Related Posts

blank
Technology and Engineering

UC Riverside Leads the Charge in Eliminating Private Data from AI Models

August 28, 2025
blank
Technology and Engineering

Exploring Long COVID: Insights from Total-Body PET Imaging

August 28, 2025
blank
Technology and Engineering

Revolutionizing Volleyball Training with Smart Robot Tech

August 28, 2025
blank
Technology and Engineering

Predicting Baseball Pitch Locations with Deep Learning Insights

August 28, 2025
blank
Technology and Engineering

New AI Tool Unveils 1,000 Potentially Unreliable Scientific Journals

August 28, 2025
blank
Technology and Engineering

Robot Regret: Innovative Research Enhances Decision-Making Safety for Robots Interacting with Humans

August 28, 2025
Next Post
Dr Jude Onwudili

Homes heated by human sewage could be a reality thanks to Aston University

  • Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27541 shares
    Share 11013 Tweet 6883
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    954 shares
    Share 382 Tweet 239
  • Bee body mass, pathogens and local climate influence heat tolerance

    642 shares
    Share 257 Tweet 161
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    509 shares
    Share 204 Tweet 127
  • Warm seawater speeding up melting of ‘Doomsday Glacier,’ scientists warn

    312 shares
    Share 125 Tweet 78
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Revolutionizing Primary Care with Generative AI Solutions
  • Transplant Policies: Undocumented Immigrants vs. Tourists
  • Enhanced Outcomes with Revised Oocyte Warming Protocol
  • Completing the Loop: A 360° Journey in Biomedical Engineering

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 4,859 other subscribers

© 2025 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2025 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading