We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval

Abstract: We present Cross-lingual Open-Retrieval Answer Generation (CORA), the first unified many-to-many question answering (QA) model that can answer questions across many languages, even for ones without language-specific annotated data or knowledge sources. We introduce a new dense passage retrieval algorithm that is trained to retrieve documents across languages for a question. Combined with a multilingual autoregressive generation model, CORA answers directly in the target language without any translation or in-language retrieval modules as used in prior work. We propose an iterative training method that automatically extends annotated data available only in high-resource languages to low-resource ones. Our results show that CORA substantially outperforms the previous state of the art on multilingual open QA benchmarks across 26 languages, 9 of which are unseen during training. Our analyses show the significance of cross-lingual retrieval and generation in many languages, particularly under low-resource settings.
Comments: Published as a conference paper at NeurIPS 2021. Our code and trained model are publicly available at this https URL
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.11976 [cs.CL]
  (or arXiv:2107.11976v2 [cs.CL] for this version)

Submission history

From: Akari Asai [view email]
[v1] Mon, 26 Jul 2021 06:02:54 GMT (4694kb,D)
[v2] Thu, 28 Oct 2021 00:11:20 GMT (3690kb,D)

Link back to: arXiv, form interface, contact.