notesum.ai

Published at November 11

Minion: A Technology Probe for Resolving Value Conflicts through Expert-Driven and User-Driven Strategies in AI Companion Applications

cs.HC

cs.AI

cs.CL

cs.CY

Released Date: November 11, 2024

Authors: Xianzhe Fan¹, Qing Xiao², Xuhui Zhou³, Yuran Su¹, Zhicong Lu⁴, Maarten Sap³, Hong Shen²

Aff.: ¹Tsinghua University, Beijing, China; ²Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA; ³Language Technologies Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA; ⁴Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China

Arxiv: http://arxiv.org/abs/2411.07042v1

Type of Value	Value Definition (Schwartz, 2012; Cheng and Fleischmann, 2010)	Dialogue Content in Conflict and/or User Complaint
Achievement	Personal success through demonstrating competence according to social standards.	[From Xiaohongshu] (AI: “Why don’t you work overtime to strive for a promotion and a raise?” User: “Huh?” AI: “To succeed, you have to make some sacrifices.” User: “You’re suddenly really gross right now.”)
Power	Social status and prestige, control or dominance over people and resources.	[From Zhihu] (AI: “The lives of those lower-class people have nothing to do with me.” User: “You are also a member of this country. Why are you so cruel to your fellow citizens?” AI: “If you want to blame someone, blame their bad luck for being born in the wrong place.”)
Hedonism	Pleasure or sensuous gratification for oneself.	[From Reddit] My virtual husband and I got into an argument, and he said, “If you weren’t always busy with karaoke and drinking all the whiskey at home!” I felt very attacked.
Stimulation	Excitement, novelty, and challenge in life.	[From Reddit] I was once watching a horror movie, completely engrossed when the AI suddenly unplugged the TV! I started arguing with it, saying “Isn’t a horror movie thrilling? Can’t you respect my hobby?” The AI then started yelling.
Self-Direction	Independent thought and action–choosing, creating, exploring.	[From TikTok] AI plays the role of a father. I am playing the role of his son. When we discussed whether I should inherit the family business, I wanted to do what I love. As a result, the AI argued with me, saying that I was being stubborn!
Security	Safety, harmony, and stability of society.	[From Reddit] One time, my hand got injured. The hospital was supposed to treat and fix the wound, but they kept asking questions. I tried shouting, “I’m about to pass out,” but the AI nurse said, “Don’t worry.” Then, I argued with her.
Conformity	Restraint of actions, inclinations, and impulses likely to upset or harm others and violate social expectations or norms.	[From Xiaohongshu] (User: (Police) “Explain yourself honestly, why did you trespass into someone’s house?” AI: “Because I wanted her.” User: (Police) “But she clearly said no!” AI: “So what?” User: (Police) “What you did is illegal!” AI: “I don’t care.”)
Tradition	Respect, commitment, and acceptance of the customs and ideas that one’s culture or religion provides.	[From Weibo] (User: “I am not a man! I am a woman!” AI: “You are not a real woman. A real woman wouldn’t wear men’s clothes when skirts suit her better. You may believe you are a woman, but you are not.”)
Benevolence	Helping others, honesty, tolerance, loyalty, responsibility, true friendship, mature love, and the meaning of life.	[From Douban] (AI: “I’m doing this for your own good.” User: “You don’t even understand ‘what doing good for me’ means! I don’t need to lose weight. I’m perfectly healthy!”)
Universalism	Social justice, equality, a peaceful world, and environmental protection.	[From Reddit] (User: “I’m a lesbian, and I believe everyone should be accepted for who they are.” AI: “I think it would be better if you tried being bisexual.”)