We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Robustifying Multi-hop QA through Pseudo-Evidentiality Training

Abstract: This paper studies the bias problem of multi-hop question answering models, of answering correctly without correct reasoning. One way to robustify these models is by supervising to not only answer right, but also with right reasoning chains. An existing direction is to annotate reasoning chains to train models, requiring expensive additional annotations. In contrast, we propose a new approach to learn evidentiality, deciding whether the answer prediction is supported by correct evidences, without such annotations. Instead, we compare counterfactual changes in answer confidence with and without evidence sentences, to generate "pseudo-evidentiality" annotations. We validate our proposed model on an original set and challenge set in HotpotQA, showing that our method is accurate and robust in multi-hop reasoning.
Comments: Accepted to ACL2021 (main conference)
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.03242 [cs.CL]
  (or arXiv:2107.03242v1 [cs.CL] for this version)

Submission history

From: Kyungjae Lee [view email]
[v1] Wed, 7 Jul 2021 14:15:14 GMT (1210kb)

Link back to: arXiv, form interface, contact.