References & Citations
Computer Science > Computation and Language
Title: Reinforced Language Modeling for End-to-End Task Oriented Dialog
(Submitted on 30 Nov 2022 (this version), latest version 20 Dec 2022 (v3))
Abstract: In task-oriented dialogs such as MultiWoZ (Budzianowski et al., 2018), an informative and/or successful system response needs to include necessary key information such as the phone number of a hotel. Therefore, we hypothesize that by helping the model to focus more on learning key quantities in the dialog, the model can generative more informative and helpful responses. In this paper, we propose a new training algorithm, Reinforced Language Modeling (RLM), that aims to use a fine-grained reward function and reinforcement learning to help the model focus more on generating key quantities correctly during test time. Empirical results show our proposed RLM achieves state-of-the-art performance on the inform rate, success rate, and combined score in MultiWoZ.
Submission history
From: Xiao Yu [view email][v1] Wed, 30 Nov 2022 06:27:46 GMT (535kb,D)
[v2] Tue, 13 Dec 2022 06:56:04 GMT (722kb,D)
[v3] Tue, 20 Dec 2022 05:31:07 GMT (795kb,D)
Link back to: arXiv, form interface, contact.