Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning
(Submitted on 18 Dec 2020 (v1), last revised 4 Jul 2021 (this version, v2))
Abstract: Query reformulation aims to alter noisy or ambiguous text sequences into coherent ones closer to natural language questions. This is to prevent errors from propagating in a client-facing pipeline and promote better communication with users. Besides, it is crucial to maintain performance in downstream environments like question answering when rephrased queries are given as input. We show that under the previous framework (AQA), attempts to alter RL algorithms do not bring significant benefits to either reward acquisition or sequence fluency. Instead, we leverage a query-reformulating text-to-text transformer (QRT5) and apply policy-based RL algorithms to further nudge this reformulator and obtain better answers downstream by generating reward-acquiring query trajectories. QRT5 shows better sample efficiency in RL to achieve the same level of QA performance as the previous approach. It can generate reformulations with more readability based on query well-formedness evaluations and can generalize to out-of-sample data. Our framework is demonstrated to be flexible, allowing reward signals to be sourced from different downstream environments such as intent classification.
Submission history
From: Jerry Zikun Chen [view email][v1] Fri, 18 Dec 2020 03:16:37 GMT (204kb,D)
[v2] Sun, 4 Jul 2021 01:08:13 GMT (210kb,D)
Link back to: arXiv, form interface, contact.