We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking

Abstract: In various natural language processing tasks, passage retrieval and passage re-ranking are two key procedures in finding and ranking relevant information. Since both the two procedures contribute to the final performance, it is important to jointly optimize them in order to achieve mutual improvement. In this paper, we propose a novel joint training approach for dense passage retrieval and passage re-ranking. A major contribution is that we introduce the dynamic listwise distillation, where we design a unified listwise training approach for both the retriever and the re-ranker. During the dynamic distillation, the retriever and the re-ranker can be adaptively improved according to each other's relevance information. We also propose a hybrid data augmentation strategy to construct diverse training instances for listwise training approach. Extensive experiments show the effectiveness of our approach on both MSMARCO and Natural Questions datasets. Our code is available at this https URL
Comments: EMNLP 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2110.07367 [cs.CL]
  (or arXiv:2110.07367v1 [cs.CL] for this version)

Submission history

From: Ruiyang Ren [view email]
[v1] Thu, 14 Oct 2021 13:52:55 GMT (380kb,D)

Link back to: arXiv, form interface, contact.