We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM arguments

Abstract: Large Language Models (LLMs) are already as persuasive as humans. However, we know very little about how they do it. This paper investigates the persuasion strategies of LLMs, comparing them with human-generated arguments. Using a dataset of 1,251 participants in an experiment, we analyze the persuasion strategies of LLM-generated and human-generated arguments using measures of cognitive effort (lexical and grammatical complexity) and moral-emotional language (sentiment and moral analysis). The study reveals that LLMs produce arguments that require higher cognitive effort, exhibiting more complex grammatical and lexical structures than human counterparts. Additionally, LLMs demonstrate a significant propensity to engage more deeply with moral language, utilizing both positive and negative moral foundations more frequently than humans. In contrast with previous research, no significant difference was found in the emotional content produced by LLMs and humans. These findings contribute to the discourse on AI and persuasion, highlighting the dual potential of LLMs to both enhance and undermine informational integrity through communication strategies for digital persuasion.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2404.09329 [cs.CL]
  (or arXiv:2404.09329v2 [cs.CL] for this version)

Submission history

From: Carlos Carrasco-Farré [view email]
[v1] Sun, 14 Apr 2024 19:01:20 GMT (364kb)
[v2] Sun, 21 Apr 2024 07:07:08 GMT (883kb)

Link back to: arXiv, form interface, contact.