References & Citations
Computer Science > Information Retrieval
Title: InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrieval
(Submitted on 4 Jan 2023 (v1), last revised 26 May 2023 (this version, v4))
Abstract: Recently, InPars introduced a method to efficiently use large language models (LLMs) in information retrieval tasks: via few-shot examples, an LLM is induced to generate relevant queries for documents. These synthetic query-document pairs can then be used to train a retriever. However, InPars and, more recently, Promptagator, rely on proprietary LLMs such as GPT-3 and FLAN to generate such datasets. In this work we introduce InPars-v2, a dataset generator that uses open-source LLMs and existing powerful rerankers to select synthetic query-document pairs for training. A simple BM25 retrieval pipeline followed by a monoT5 reranker finetuned on InPars-v2 data achieves new state-of-the-art results on the BEIR benchmark. To allow researchers to further improve our method, we open source the code, synthetic data, and finetuned models: this https URL
Submission history
From: Vitor Jeronymo [view email][v1] Wed, 4 Jan 2023 20:58:43 GMT (27kb)
[v2] Sat, 14 Jan 2023 21:49:36 GMT (27kb)
[v3] Thu, 23 Feb 2023 13:58:24 GMT (27kb)
[v4] Fri, 26 May 2023 22:16:38 GMT (27kb)
Link back to: arXiv, form interface, contact.