We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Keywords Reinforcement LM: Improving End-to-End Response Generation in Task Oriented Dialog

Abstract: In task-oriented dialogs such as MultiWoZ (Budzianowski et al., 2018), an informative and successful system response needs to include key information such as the phone number of a hotel. Therefore, we hypothesize that by asking the model to focus on generating more key quantities correctly, it can achieve better overall performance. In this paper, we propose a new training algorithm, Keywords Reinforcement Language Modeling (KRLM), that aims to use a fine-grained reward function for each token and a new per-token Reinforcement Learning procedure to help the model learn keywords generation more robustly during inference. Empirical results show that our proposed KRLM training algorithm can achieve state-of-the-art performance on the inform rate, success rate, and combined score in the MultiWoZ benchmark dataset.
Comments: added algorithm analysis, and supplemental information such as error examples and more training/validation curves
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2211.16773 [cs.CL]
  (or arXiv:2211.16773v2 [cs.CL] for this version)

Submission history

From: Xiao Yu [view email]
[v1] Wed, 30 Nov 2022 06:27:46 GMT (535kb,D)
[v2] Tue, 13 Dec 2022 06:56:04 GMT (722kb,D)
[v3] Tue, 20 Dec 2022 05:31:07 GMT (795kb,D)

Link back to: arXiv, form interface, contact.