We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: DORA: Toward Policy Optimization for Task-oriented Dialogue System with Efficient Context

Abstract: Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented dialogue system, called Dialogue System with Optimizing a Recurrent Action Policy using Efficient Context (DORA), that uses SL, with subsequently applied RL to optimize dialogue systems using a recurrent dialogue policy. This dialogue policy recurrently generates explicit system actions as a both word-level and high-level policy. As a result, DORA is clearly optimized during both SL and RL steps by using an explicit system action policy that considers an efficient context instead of the entire dialogue history. The system actions are both interpretable and controllable, whereas the latent actions are not. DORA improved the success rate by 6.6 points on MultiWOZ 2.0 and by 10.9 points on MultiWOZ 2.1.
Comments: 23 pages, 9 figures, submitted to Computer Speech ans Language journal
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.03286 [cs.CL]
  (or arXiv:2107.03286v1 [cs.CL] for this version)

Submission history

From: Hyunmin Jeon [view email]
[v1] Wed, 7 Jul 2021 15:24:27 GMT (575kb,D)

Link back to: arXiv, form interface, contact.