References & Citations
Computer Science > Computation and Language
Title: Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?
(Submitted on 23 Feb 2020 (v1), last revised 27 Jan 2021 (this version, v2))
Abstract: Multi-hop question answering (QA) requires a model to retrieve and integrate information from different parts of a long text to answer a question. Humans answer this kind of complex questions via a divide-and-conquer approach. In this paper, we investigate whether top-performing models for multi-hop questions understand the underlying sub-questions like humans. We adopt a neural decomposition model to generate sub-questions for a multi-hop complex question, followed by extracting the corresponding sub-answers. We show that multiple state-of-the-art multi-hop QA models fail to correctly answer a large portion of sub-questions, although their corresponding multi-hop questions are correctly answered. This indicates that these models manage to answer the multi-hop questions using some partial clues, instead of truly understanding the reasoning paths. We also propose a new model which significantly improves the performance on answering the sub-questions. Our work takes a step forward towards building a more explainable multi-hop QA system.
Submission history
From: Yixuan Tang [view email][v1] Sun, 23 Feb 2020 15:16:43 GMT (510kb,D)
[v2] Wed, 27 Jan 2021 04:18:57 GMT (551kb,D)
Link back to: arXiv, form interface, contact.