References & Citations
Computer Science > Computation and Language
Title: Best-First Beam Search
(Submitted on 8 Jul 2020 (v1), last revised 15 Nov 2022 (this version, v5))
Abstract: Decoding for many NLP tasks requires an effective heuristic algorithm for approximating exact search since the problem of searching the full output space is often intractable, or impractical in many settings. The default algorithm for this job is beam search -- a pruned version of breadth-first search. Quite surprisingly, beam search often returns better results than exact inference due to beneficial search bias for NLP tasks. In this work, we show that the standard implementation of beam search can be made up to 10x faster in practice. Our method assumes that the scoring function is monotonic in the sequence length, which allows us to safely prune hypotheses that cannot be in the final set of hypotheses early on. We devise effective monotonic approximations to popular nonmonontic scoring functions, including length normalization and mutual information decoding. Lastly, we propose a memory-reduced variant of Best-First Beam Search, which has a similar beneficial search bias in terms of downstream performance, but runs in a fraction of the time.
Submission history
From: Clara Meister [view email][v1] Wed, 8 Jul 2020 05:56:01 GMT (234kb,D)
[v2] Thu, 9 Jul 2020 09:56:49 GMT (234kb,D)
[v3] Sun, 17 Jan 2021 09:31:46 GMT (7672kb,D)
[v4] Mon, 30 Aug 2021 16:42:16 GMT (7676kb,D)
[v5] Tue, 15 Nov 2022 12:49:37 GMT (7675kb,D)
Link back to: arXiv, form interface, contact.