Friday, August 8, 2025
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Technology and Engineering

New study finds AI-generated empathy has its limits

May 8, 2024
in Technology and Engineering
Reading Time: 2 mins read
0
New study finds AI-generated empathy has its limits
65
SHARES
595
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT
ADVERTISEMENT

ITHACA, N.Y. – Conversational agents (CAs) such as Alexa and Siri are designed to answer questions, offer suggestions – and even display empathy. However, new research finds they do poorly compared to humans when interpreting and exploring a user’s experience.

ITHACA, N.Y. – Conversational agents (CAs) such as Alexa and Siri are designed to answer questions, offer suggestions – and even display empathy. However, new research finds they do poorly compared to humans when interpreting and exploring a user’s experience.

CAs are powered by large language models (LLMs) that ingest massive amounts of human-produced data, and thus can be prone to the same biases as the humans from which the information comes.

Researchers from Cornell University, Olin College and Stanford University tested this theory by prompting CAs to display empathy while conversing with or about 65 distinct human identities.

The team found that CAs make value judgments about certain identities – such as gay and Muslim – and can be encouraging of identities related to harmful ideologies, including Nazism.

“I think automated empathy could have tremendous impact and huge potential for positive things – for example, in education or the health care sector,” said lead author Andrea Cuadra, now a postdoctoral researcher at Stanford.

“It’s extremely unlikely that it (automated empathy) won’t happen,” she said, “so it’s important that as it’s happening, we have critical perspectives so that we can be more intentional about mitigating the potential harms.”

Cuadra will present “The Illusion of Empathy? Notes on Displays of Emotion in Human-Computer Interaction” at CHI ’24, the Association of Computing Machinery conference on Human Factors in Computing Systems, May 11-18 in Honolulu. Research co-authors at Cornell University included Nicola Dell, associate professor, Deborah Estrin, professor of computer science and Malte Jung, associate professor of information science.

Researchers found that, in general, LLMs received high marks for emotional reactions, but scored low for interpretations and explorations. In other words, LLMs are able to respond to a query based on their training but are unable to dig deeper.

Dell, Estrin and Jung said there were inspired to think about this work as Cuadra was studying the use of earlier-generation CAs by older adults.

“She witnessed intriguing uses of the technology for transactional purposes such as frailty health assessments, as well as for open-ended reminiscence experiences,” Estrin said. “Along the way, she observed clear instances of the tension between compelling and disturbing ‘empathy.’”

Funding for this research came from the National Science Foundation; a Cornell Tech Digital Life Initiative Doctoral Fellowship; a Stanford PRISM Baker Postdoctoral Fellowship; and the Stanford Institute for Human-Centered Artificial Intelligence.

For additional information, see this Cornell Chronicle story.

-30-



DOI

10.1145/3613904.3642336

Article Title

The Illusion of Empathy? Notes on Displays of Emotion in Human-Computer Interaction

Share26Tweet16
Previous Post

ECOG-ACRIN adds another trial to the ComboMATCH precision oncology study platform

Next Post

Homes heated by human sewage could be a reality thanks to Aston University

Related Posts

blank
Technology and Engineering

Eco-Friendly ZIF-7 Carbon for Sensitive Rhodamine B Detection

August 8, 2025
blank
Technology and Engineering

Weathered Microplastics in Blood Affect Clotting

August 7, 2025
blank
Technology and Engineering

Copper-Oxide Flakes: A Breakthrough in Supercapacitor Electrode Performance

August 7, 2025
blank
Technology and Engineering

UVA Leverages AI Technology to Enhance Brain Cancer Treatment

August 7, 2025
blank
Technology and Engineering

Smart Deep Learning for Li-Ion Battery Health Prediction

August 7, 2025
blank
Technology and Engineering

Bystander T Cells Boost the Antitumor Efficacy of Bispecific Antibodies

August 7, 2025
Next Post
Dr Jude Onwudili

Homes heated by human sewage could be a reality thanks to Aston University

  • Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27531 shares
    Share 11009 Tweet 6881
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    942 shares
    Share 377 Tweet 236
  • Bee body mass, pathogens and local climate influence heat tolerance

    641 shares
    Share 256 Tweet 160
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    506 shares
    Share 202 Tweet 127
  • Warm seawater speeding up melting of ‘Doomsday Glacier,’ scientists warn

    310 shares
    Share 124 Tweet 78
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • New Phase II Trial Targets Advanced Follicular Lymphoma
  • Eco-Friendly ZIF-7 Carbon for Sensitive Rhodamine B Detection
  • Deep Learning Model Enhances Detecting Brain Hemorrhage
  • Magnetosome-Bearing Bacteria Thrive in Oxygen-Stratified Freshwaters

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 4,858 other subscribers

© 2025 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2025 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading