Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: A Benchmarking Environment for Reinforcement Learning Based Task Oriented Dialogue Management
(Submitted on 29 Nov 2017 (v1), last revised 6 Apr 2018 (this version, v2))
Abstract: Dialogue assistants are rapidly becoming an indispensable daily aid. To avoid the significant effort needed to hand-craft the required dialogue flow, the Dialogue Management (DM) module can be cast as a continuous Markov Decision Process (MDP) and trained through Reinforcement Learning (RL). Several RL models have been investigated over recent years. However, the lack of a common benchmarking framework makes it difficult to perform a fair comparison between different models and their capability to generalise to different environments. Therefore, this paper proposes a set of challenging simulated environments for dialogue model development and evaluation. To provide some baselines, we investigate a number of representative parametric algorithms, namely deep reinforcement learning algorithms - DQN, A2C and Natural Actor-Critic and compare them to a non-parametric model, GP-SARSA. Both the environments and policy models are implemented using the publicly available PyDial toolkit and released on-line, in order to establish a testbed framework for further experiments and to facilitate experimental reproducibility.
Submission history
From: Paweł Budzianowski [view email][v1] Wed, 29 Nov 2017 18:51:14 GMT (650kb,D)
[v2] Fri, 6 Apr 2018 10:50:44 GMT (305kb,D)
Link back to: arXiv, form interface, contact.