We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Digital Libraries

Title: Investigating Disagreement in the Scientific Literature

Authors: Wout S. Lamers (1), Kevin Boyack (2), Vincent Larivière (3), Cassidy R. Sugimoto (4), Nees Jan van Eck (1), Ludo Waltman (1), Dakota Murray (4) ((1) Centre for Science and Technology Studies, Leiden University, Leiden, Netherlands, (2) SciTech Strategies, Inc., Albuquerque, NM, USA, (3) École de bibliothéconomie et des sciences de l'information, Université de Montréal, Canada, (4) School of Informatics, Computing, and Engineering, Indiana University Bloomington, IN, USA)
Abstract: Disagreement is essential to scientific progress. However, the extent of disagreement in science, its evolution over time, and the fields in which it happens, remains poorly understood. Leveraging a massive collection of English-language scientific texts, we develop a cue-phrase based approach to identify instances of disagreement citations across more than four million scientific articles. Using this method, we construct an indicator of disagreement across scientific fields over the 2000-2015 period. In contrast with black-box text classification methods, our framework is transparent and easily interpretable. We reveal a disciplinary spectrum of disagreement, with higher disagreement in the social sciences and lower disagreement in physics and mathematics. However, detailed disciplinary analysis demonstrates heterogeneity across sub-fields, revealing the importance of local disciplinary cultures and epistemic characteristics of disagreement. Paper-level analysis reveals notable episodes of disagreement in science, and illustrates how methodological artifacts can confound analyses of scientific texts. These findings contribute to a broader understanding of disagreement and establish a foundation for future research to understanding key processes underlying scientific progress.
Comments: 49 pages, 10 figures
Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL)
Cite as: arXiv:2107.14641 [cs.DL]
  (or arXiv:2107.14641v2 [cs.DL] for this version)

Submission history

From: Wout S. Lamers [view email]
[v1] Fri, 30 Jul 2021 14:07:34 GMT (4204kb)
[v2] Wed, 27 Oct 2021 21:53:51 GMT (4245kb)

Link back to: arXiv, form interface, contact.