核心发现
方法论
本研究构建了一个包含1017段人类对话的语料库,采用内容分析法设计了十类说服策略的注释体系。基于此,开发了融合句子嵌入、上下文信息和句子级特征的混合RCNN模型,用于策略分类。模型输入包括预训练的FastText词向量、句子和上下文的RNN编码、情感特征、字符级特征和句子位置编码。通过五折交叉验证,模型在ANNSET数据集上达到了74.8%的准确率和59.6%的宏平均F1值。研究还结合受试者的人口统计和心理特征,分析不同背景下策略的效果差异,为个性化对话系统提供理论基础。
关键结果
- 提出的混合RCNN模型在10类说服策略分类任务中达到了74.8%的准确率和59.6%的宏F1分数,明显优于传统的BLSTM和CNN模型(分别为73.4%和73.5%的准确率),验证了多特征融合的有效性。
- 在策略分布分析中,Credibility appeal在对话开始时频繁出现,Donation information则集中在对话后期,反映了策略的时间动态特征。不同背景的受试者对策略的响应差异显著,揭示个性化设计的潜力。
- 通过对模型的消融实验,发现句子嵌入和情感特征对分类性能影响最大,结合上下文信息虽略有提升,但受对话长短和语义复杂度限制,未来需优化上下文编码方法。
研究意义
本研究填补了自动化个性化说服对话系统的空白,结合社会心理学理论与深度学习技术,推动了社会公益领域的智能交互应用。通过大规模数据和多策略模型,有望实现更具效果和个性化的公益宣传,提升公众参与度,具有深远的社会影响。同时,为未来研究提供了数据基础和模型框架,促进人机交互的伦理发展。
技术贡献
本研究的核心技术创新在于提出融合句子、上下文和句子级特征的混合RCNN模型,用于多策略分类。引入多模态特征(如情感、字符、位置编码)显著提升模型性能,突破了传统单一特征模型的局限。数据集的构建和策略注释体系,为在线对话中的策略识别提供了标准化工具。结合心理背景分析,为个性化策略推荐奠定了基础,推动了深度学习在社会科学中的应用边界。
新颖性
本研究首次在大规模人类对话中系统识别和分类十类说服策略,结合心理学背景分析,探索个性化策略效果。不同于以往仅关注单轮或静态文本的研究,我们采用多特征融合的深度模型,兼顾对话动态和语义复杂性,创新性地实现策略识别与个性化分析的结合,为社会公益对话系统提供了理论与技术基础。
局限性
- 模型在长对话和复杂语义场景下仍存在误分类,尤其是Personal story与Emotion appeal的混淆,表明对上下文理解仍需改进。
- 数据采集主要依赖于AMT平台,样本偏向于特定人群,可能影响模型的泛化能力,未来需扩展多源数据以提升鲁棒性。
- 策略分类的粒度有限,未来可考虑多标签、多层次策略识别,以更细粒度反映说服过程中的多重心理机制。
未来方向
未来将结合多模态数据(如语音、表情)丰富模型输入,提升策略识别的准确性。探索个性化策略推荐机制,结合用户心理和背景信息,优化对话交互效果。同时,推动模型在真实社会公益场景中的应用测试,评估其实际影响力,逐步实现自动化、个性化的公益说服系统。
AI 总览摘要
在当今社会,利用人工智能实现有效的公益宣传已成为研究热点。传统的公益推广多依赖人工或静态信息传递,缺乏个性化和互动性,难以激发公众的积极参与。近年来,深度学习和对话系统的快速发展为解决这一难题提供了新的可能性。本研究提出了一种基于深度学习的个性化说服对话系统框架,旨在通过理解和模拟人类的说服策略,提升公益信息的传播效果。
首先,研究团队在Amazon Mechanical Turk平台上设计了一个大规模的人类对话数据集,包含1017段真实的说服对话,涉及不同背景的参与者。为了深入理解说服过程,团队开发了十类策略的注释体系,包括逻辑、情感、信誉、脚踏实地、自我示范、个人故事、捐赠信息以及源头、任务和个人相关询问。通过内容分析法,标注了300段对话,形成了具有代表性的数据集ANNSET。
在模型设计方面,研究提出了融合句子嵌入、上下文信息和句子级特征的混合RCNN模型。该模型结合了预训练的FastText词向量、双向LSTM编码、情感分析(采用VADER工具)、字符级特征和句子位置编码,有效捕获对话中的语义和策略特征。通过五折交叉验证,模型在策略分类任务中达到了74.8%的准确率和59.6%的宏平均F1分数,优于传统的BLSTM和CNN模型。
分析结果显示,不同策略在对话中的分布具有明显的时间和语义特征。例如,信誉策略多在开头出现,而捐赠信息集中在后期。模型的消融实验验证了多模态特征融合的重要性,情感特征对提升性能尤为关键。这些技术创新为未来个性化公益对话系统的开发提供了坚实基础。
此外,研究还结合受试者的人口统计和心理特征,分析不同背景对策略效果的影响。结果表明,个性化策略的设计应考虑受众的心理状态和价值观,才能实现更高的公益转化率。这一发现为智能公益宣传提供了理论支撑,也为实际应用中的个性化推荐和策略调整提供了方向。
总之,本研究在数据集构建、模型创新和个性化分析方面取得了突破,推动了社会公益领域的智能化发展。未来,结合多模态数据和更复杂的心理模型,有望实现更具效果的公益说服系统,促进社会公益事业的持续进步。
深度解读
原文摘要
Developing intelligent persuasive conversational agents to change people's opinions and actions for social good is the frontier in advancing the ethical development of automated dialogue systems. To do so, the first step is to understand the intricate organization of strategic disclosures and appeals employed in human persuasion conversations. We designed an online persuasion task where one participant was asked to persuade the other to donate to a specific charity. We collected a large dataset with 1,017 dialogues and annotated emerging persuasion strategies from a subset. Based on the annotation, we built a baseline classifier with context information and sentence-level features to predict the 10 persuasion strategies used in the corpus. Furthermore, to develop an understanding of personalized persuasion processes, we analyzed the relationships between individuals' demographic and psychological backgrounds including personality, morality, value systems, and their willingness for donation. Then, we analyzed which types of persuasion strategies led to a greater amount of donation depending on the individuals' personal backgrounds. This work lays the ground for developing a personalized persuasive dialogue system.
参考文献 (20)
Reliability in Content Analysis: Some Common Misconceptions and Recommendations
K. Krippendorff
Learning by Communicating in Natural Language With Conversational Agents
A. Graesser, Haiying Li, Carol M. Forsyth
VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text
C. J. Hutto, Eric Gilbert
Moral Foundations Theory: The Pragmatic Validity of Moral Pluralism
J. Graham, J. Haidt, S. Koleva 等
A comparison of the invariance properties of the PVQ-40 and the PVQ-21 to measure human values across German and Polish Samples
Jan Cieciuch, E. Davidov
Mapping the Moral Domain
J. Graham, Brian A. Nosek, J. Haidt 等
The Psychology of Tailoring-Ingredients in Computer-Tailored Persuasion
A. Dijkstra
A Human-Computer Dialogue System for Educational Debate: A Computational Dialectics Approach
Tangming Yuan, D. Moore, Alec Grierson
Guilt appeals: persuasion knowledge and charitable giving
S. Hibbert, Andrew Smith, Andrea Davies 等
Advancing Tailored Health Communication: A Persuasion and Message Effects Perspective
B. Rimer, M. Kreuter
Recurrent Convolutional Neural Networks for Text Classification
Siwei Lai, Liheng Xu, Kang Liu 等
Persuasive technology: using computers to change what we think and do
James Kalbach
The automated design of believable dialogues for animated presentation teams
Elisabeth André, T. Rist, Susanne van Mulken 等
One size does not fit all: The case for tailoring print materials
M. Kreuter, V. Strecher, B. Glassman
The Pleadings Game
T. Gordon
Modifying Socially-Conscious Behavior: The Foot-in-the-Door Technique
C. Scott
Moral Framing and Charitable Donation : Integrating Exploratory Social Media Analyses and Confirmatory Experimentation
B. Donnellan
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, A. Krizhevsky 等
THE DEVELOPMENT OF MARKERS FOR THE BIG-FIVE FACTOR STRUCTURE
L. R. Goldberg
被引用 (20)
PersuHSG: Adaptive Persuasion Strategy Planning for Dialogue Agents Based on Hierarchical Strategy Graph
How Much Does Persuasion Strategy Matter? LLM-Annotated Evidence from Charitable Donation Dialogues
METRO: Towards Strategy Induction from Expert Dialogue Transcripts for Non-collaborative Dialogues
Enhancing Persuasive Dialogue Agents by Synthesizing Cross-Disciplinary Communication Strategies
When Evidence is Sparse: Weakly Supervised Early Failure Alerting in Dialogs and LLM-Agent Trajectories
Detecting Winning Arguments with Large Language Models and Persuasion Strategies
Personality-Aware Reinforcement Learning for Persuasive Dialogue with LLM-Driven Simulation
One Frozen Simulator Is Not Enough: Simulator Collapse in Multi-Agent RL
A General Highly Accurate Online Planning Method Integrating Large Language Models into Nested Rollout Policy Adaptation for Dialogue Tasks
Cognitive World Model for Progressive BDI/E Trajectory Evaluation of Conversational Agents
Information Dynamics of Language Communication
Planner Policies are Bias Learners: A Comprehensive Analysis of Preference Bias in LLM-based Dialogue Planner Policies
Not My Truce: Personality Differences in AI-Mediated Workplace Negotiation
Effective Engagement by Agents for Sense of Ownership and Self-Determination
Characterizing AI Manipulation Risks in Brazilian YouTube Climate Discourse
UP-NRPA: User Portrait based Nested Rollout Policy Adaptation for Planning with Large Language Models in Goal-oriented Dialogue Systems
Train Yourself as an LLM: Exploring Effects of AI Literacy on Persuasion via Role-playing LLM Training
LLM-in-the-Loop Descriptor Prompt Refinement for Dialogue-Based Big Five Personality Recognition
The Hidden Puppet Master: Predicting Human Belief Change in Manipulative LLM Dialogues
PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance