notesum.ai

Published at November 19

The Illusion of Empathy: How AI Chatbots Shape Conversation Perception

cs.HC

cs.AI

Released Date: November 19, 2024

Authors: Tingting Liu¹, Salvatore Giorgi¹, Ankit Aich², Allison Lahnala¹, Brenda Curtis¹, Lyle Ungar³, João Sedoc

Aff.: ¹National Institute on Drug Abuse; ²National Institute on Drug Abuse, University of Pennsylvania; ³University of Pennsylvania

Arxiv: http://arxiv.org/abs/2411.12877v1

Analysis	$r$ overall	$r$ human	$r$ chatbot	mean human	mean chatbot	$t$	$p$ -value
Psychological Ratings
General Empathy	-	-	-	5.42	4.04	5.37	$<$ 0.001
Overall State Empathy	-	-	-	2.58	2.00	4.06	$<$ 0.001
Affective State Empathy	-	-	-	2.37	1.62	4.54	$<$ 0.001
Cognitive State Empathy	-	-	-	2.66	2.33	2.26	0.025
Associative State Empathy	-	-	-	2.70	2.04	4.28	$<$ 0.001
Closeness	-	-	-	4.23	4.28	-0.23	0.82
Off-the-Shelf Models
Batson Empathy	0.11	0.15	0.08	4.50	4.49	0.09	0.93
Interpret	0.21	0.16	-0.19	0.31	0.07	6.77	$<$ 0.001
Emo-React	-0.02	0.25	0.19	0.32	0.52	-5.20	$<$ 0.001
Explore	-0.11	-0.16	-0.17	0.65	0.59	0.93	0.35
Perceived Empathy Model	0.12	0.17	0.09	5.99	6.00	0.45	0.65
Large Language Models	0.07	0.20	0.06	4.98	4.10	3.54	$<$ 0.001