We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge

Abstract: Claim detection and verification are crucial for news understanding and have emerged as promising technologies for mitigating misinformation and disinformation in the news. However, most existing work has focused on claim sentence analysis while overlooking additional crucial attributes (e.g., the claimer and the main object associated with the claim). In this work, we present NewsClaims, a new benchmark for attribute-aware claim detection in the news domain. We extend the claim detection problem to include extraction of additional attributes related to each claim and release 889 claims annotated over 143 news articles. NewsClaims aims to benchmark claim detection systems in emerging scenarios, comprising unseen topics with little or no training data. To this end, we see that zero-shot and prompt-based baselines show promising performance on this benchmark, while still considerably behind human performance.
Comments: Accepted at EMNLP 2022
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as: arXiv:2112.08544 [cs.CL]
  (or arXiv:2112.08544v4 [cs.CL] for this version)

Submission history

From: Revanth Reddy [view email]
[v1] Thu, 16 Dec 2021 00:50:24 GMT (2079kb,D)
[v2] Mon, 14 Mar 2022 23:19:29 GMT (7638kb,D)
[v3] Tue, 24 May 2022 13:19:20 GMT (4208kb,D)
[v4] Wed, 23 Nov 2022 20:43:56 GMT (8390kb,D)

Link back to: arXiv, form interface, contact.