We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning

Abstract: Machine Reading Comprehension with Unanswerable Questions is a difficult NLP task, challenged by the questions which can not be answered from passages. It is observed that subtle literal changes often make an answerable question unanswerable, however, most MRC models fail to recognize such changes. To address this problem, in this paper, we propose a span-based method of Contrastive Learning (spanCL) which explicitly contrast answerable questions with their answerable and unanswerable counterparts at the answer span level. With spanCL, MRC models are forced to perceive crucial semantic changes from slight literal differences. Experiments on SQuAD 2.0 dataset show that spanCL can improve baselines significantly, yielding 0.86-2.14 absolute EM improvements. Additional experiments also show that spanCL is an effective way to utilize generated questions.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2208.01299 [cs.CL]
  (or arXiv:2208.01299v1 [cs.CL] for this version)

Submission history

From: Liangyu Chen [view email]
[v1] Tue, 2 Aug 2022 08:09:05 GMT (1341kb,D)

Link back to: arXiv, form interface, contact.