We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Overview and Insights from the SciVer Shared Task on Scientific Claim Verification

Abstract: We present an overview of the SciVer shared task, presented at the 2nd Scholarly Document Processing (SDP) workshop at NAACL 2021. In this shared task, systems were provided a scientific claim and a corpus of research abstracts, and asked to identify which articles SUPPORT or REFUTE the claim as well as provide evidentiary sentences justifying those labels. 11 teams made a total of 14 submissions to the shared task leaderboard, leading to an improvement of more than +23 F1 on the primary task evaluation metric. In addition to surveying the participating systems, we provide several insights into modeling approaches to support continued progress and future research on the important and challenging task of scientific claim verification.
Comments: SciVer shared task, presented at the 2nd Scholarly Document Processing (SDP) workshop at NAACL 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.08188 [cs.CL]
  (or arXiv:2107.08188v1 [cs.CL] for this version)

Submission history

From: David Wadden [view email]
[v1] Sat, 17 Jul 2021 05:47:57 GMT (32kb,D)

Link back to: arXiv, form interface, contact.