We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Retrieval

Title: Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval

Abstract: In monolingual dense retrieval, lots of works focus on how to distill knowledge from cross-encoder re-ranker to dual-encoder retriever and these methods achieve better performance due to the effectiveness of cross-encoder re-ranker. However, we find that the performance of the cross-encoder re-ranker is heavily influenced by the number of training samples and the quality of negative samples, which is hard to obtain in the cross-lingual setting. In this paper, we propose to use a query generator as the teacher in the cross-lingual setting, which is less dependent on enough training samples and high-quality negative samples. In addition to traditional knowledge distillation, we further propose a novel enhancement method, which uses the query generator to help the dual-encoder align queries from different languages, but does not need any additional parallel sentences. The experimental results show that our method outperforms the state-of-the-art methods on two benchmark datasets.
Comments: EMNLP 2022 main conference
Subjects: Information Retrieval (cs.IR)
Cite as: arXiv:2303.14991 [cs.IR]
  (or arXiv:2303.14991v1 [cs.IR] for this version)

Submission history

From: Ning Wu [view email]
[v1] Mon, 27 Mar 2023 08:34:42 GMT (1832kb,D)

Link back to: arXiv, form interface, contact.