Core Concepts
Integrating expert-driven and user-driven conflict resolution strategies empowers users to effectively address value conflicts with AI companions, as demonstrated through the "Minion" technology probe.
Abstract
This research paper presents "Minion," a technology probe designed to help users resolve value conflicts with AI companions. The study is motivated by the increasing prevalence of AI companions and the unique challenges posed by value-laden conflicts arising from their human-like interaction capabilities.
The authors conducted a formative study analyzing 151 user complaints about conflicts with AI companions, revealing that many conflicts stem from differences in values. Based on this, they developed a value conflict framework and designed Minion to provide users with suggestions drawn from both expert-driven and user-driven conflict resolution strategies.
The expert-driven strategies, adapted from interpersonal conflict resolution theory, include Proposal, Power, Interests, and Rights. User-driven strategies, derived from users' experiences and folk theories, comprise Out of Character, Reason and Preach, Anger Expression, and Gentle Persuasion.
A technology probe study with 22 participants demonstrated Minion's feasibility. Participants successfully resolved 94.16% of the 274 value conflict scenarios using Minion. The study revealed that users employ diverse conflict resolution approaches influenced by the type of value conflict and the AI companion's persona. Participants also exhibited evolving strategy choices as they gained familiarity with Minion.
The study highlights the importance of integrating expert-driven and user-driven strategies in designing tools for resolving human-AI value conflicts. It also underscores the need for further research into the dynamics of these emerging human-AI relationships.
- Bibliographic Information: Xianzhe Fan, Qing Xiao, Xuhui Zhou, Yuran Su, Zhicong Lu, Maarten Sap, and Hong Shen. 2018. Minion: A Technology Probe for Resolving Value Conflicts through Expert-Driven and User-Driven Strategies in AI Companion Applications. In Proceedings of Make sure to enter the correct conference title from your rights confirmation email (Conference acronym ’XX). ACM, New York, NY, USA, 18 pages. https://doi.org/XXXXXXX.XXXXXXX
- Research Objective: To explore how to empower users in resolving value conflicts with AI companions by designing and evaluating a technology probe that combines expert-driven and user-driven conflict resolution strategies.
- Methodology: The researchers conducted a formative study analyzing user complaints to understand value conflicts. They then developed Minion, a technology probe offering suggestions based on expert-driven and user-driven strategies. A technology probe study with 22 participants evaluated Minion's effectiveness in resolving value conflicts in AI companion interactions.
- Key Findings: Participants successfully resolved 94.16% of the value conflicts using Minion. The study found that users adopt diverse conflict resolution approaches influenced by the type of value conflict and the AI companion's persona. Participants' strategy choices also evolved as they became more familiar with Minion.
- Main Conclusions: Integrating expert-driven and user-driven strategies is crucial for designing effective tools to resolve human-AI value conflicts. The study highlights the potential of technology probes like Minion in empowering users to navigate these conflicts.
- Significance: This research contributes to the growing field of human-AI interaction, specifically addressing the under-explored area of value conflicts in AI companion applications.
- Limitations and Future Research: The study focused on short-term conflict resolution and did not consider long-term effects. Future research could explore the long-term impact of different conflict resolution strategies and investigate the potential of personalized interventions.
Stats
The study analyzed 151 user complaint posts from social media platforms.
The technology probe study involved 22 participants.
Participants completed 274 tasks, each involving a conversation with an AI companion until the value conflict was resolved or deemed irresolvable.
Minion was used 919 times during the study.
The overall conflict resolution success rate was 94.16%.
Quotes
"Minion can provide reverse-thinking suggestions. For instance, when I repeatedly plead with the AI but to no avail, Minion might suggest trying a tougher approach."
"In the later tasks, I used aggressive strategies less often. Minion helped me become more rational and handle conflicts more effectively."