We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics

Abstract: We investigate how well BERT performs on predicting factuality in several existing English datasets, encompassing various linguistic constructions. Although BERT obtains a strong performance on most datasets, it does so by exploiting common surface patterns that correlate with certain factuality labels, and it fails on instances where pragmatic reasoning is necessary. Contrary to what the high performance suggests, we are still far from having a robust system for factuality prediction.
Comments: to be published in TACL, pre-MIT Press publication version
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.00807 [cs.CL]
  (or arXiv:2107.00807v1 [cs.CL] for this version)

Submission history

From: Nanjiang Jiang [view email]
[v1] Fri, 2 Jul 2021 02:47:25 GMT (468kb,D)

Link back to: arXiv, form interface, contact.