References & Citations
Computer Science > Computation and Language
Title: Zero-Shot Retrieval with Search Agents and Hybrid Environments
(Submitted on 30 Sep 2022 (this version), latest version 29 Mar 2023 (v2))
Abstract: Learning to search is the task of building artificial agents that learn to autonomously use a search box to find information. So far, it has been shown that current language models can learn symbolic query reformulation policies, in combination with traditional term-based retrieval, but fall short of outperforming neural retrievers. We extend the previous learning to search setup to a hybrid environment, which accepts discrete query refinement operations, after a first-pass retrieval step performed by a dual encoder. Experiments on the BEIR task show that search agents, trained via behavioral cloning, outperform the underlying search system based on a combined dual encoder retriever and cross encoder reranker. Furthermore, we find that simple heuristic Hybrid Retrieval Environments (HRE) can improve baseline performance by several nDCG points. The search agent based on HRE (HARE) produces state-of-the-art performance on both zero-shot and in-domain evaluations. We carry out an extensive qualitative analysis to shed light on the agents policies.
Submission history
From: Christian Buck [view email][v1] Fri, 30 Sep 2022 13:50:25 GMT (220kb,D)
[v2] Wed, 29 Mar 2023 13:29:35 GMT (233kb,D)
Link back to: arXiv, form interface, contact.