Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Uncertainty Estimates for Efficient Neural Network-based Dialogue Policy Optimisation
(Submitted on 30 Nov 2017)
Abstract: In statistical dialogue management, the dialogue manager learns a policy that maps a belief state to an action for the system to perform. Efficient exploration is key to successful policy optimisation. Current deep reinforcement learning methods are very promising but rely on epsilon-greedy exploration, thus subjecting the user to a random choice of action during learning. Alternative approaches such as Gaussian Process SARSA (GPSARSA) estimate uncertainties and are sample efficient, leading to better user experience, but on the expense of a greater computational complexity. This paper examines approaches to extract uncertainty estimates from deep Q-networks (DQN) in the context of dialogue management. We perform an extensive benchmark of deep Bayesian methods to extract uncertainty estimates, namely Bayes-By-Backprop, dropout, its concrete variation, bootstrapped ensemble and alpha-divergences, combining it with DQN algorithm.
Submission history
From: Paweł Budzianowski [view email][v1] Thu, 30 Nov 2017 16:09:02 GMT (101kb,D)
Link back to: arXiv, form interface, contact.