We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CY

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computers and Society

Title: AI model GPT-3 (dis)informs us better than humans

Abstract: Artificial intelligence is changing the way we create and evaluate information, and this is happening during an infodemic, which has been having dramatic effects on global health. In this paper we evaluate whether recruited individuals can distinguish disinformation from accurate information, structured in the form of tweets, and determine whether a tweet is organic or synthetic, i.e., whether it has been written by a Twitter user or by the AI model GPT-3. Our results show that GPT-3 is a double-edge sword, which, in comparison with humans, can produce accurate information that is easier to understand, but can also produce more compelling disinformation. We also show that humans cannot distinguish tweets generated by GPT-3 from tweets written by human users. Starting from our results, we reflect on the dangers of AI for disinformation, and on how we can improve information campaigns to benefit global health.
Comments: dataset and software: this https URL 29 pages, 4 figures, 13 supplementary figures
Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
Journal reference: Sci. Adv.9,eadh1850(2023)
DOI: 10.1126/sciadv.adh1850
Cite as: arXiv:2301.11924 [cs.CY]
  (or arXiv:2301.11924v2 [cs.CY] for this version)

Submission history

From: Giovanni Spitale [view email]
[v1] Mon, 23 Jan 2023 14:36:29 GMT (2643kb)
[v2] Tue, 31 Jan 2023 10:14:03 GMT (6035kb)

Link back to: arXiv, form interface, contact.