Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Regret Analysis for Continuous Dueling Bandit
(Submitted on 21 Nov 2017 (v1), last revised 12 Dec 2017 (this version, v2))
Abstract: The dueling bandit is a learning framework wherein the feedback information in the learning process is restricted to a noisy comparison between a pair of actions. In this research, we address a dueling bandit problem based on a cost function over a continuous space. We propose a stochastic mirror descent algorithm and show that the algorithm achieves an $O(\sqrt{T\log T})$-regret bound under strong convexity and smoothness assumptions for the cost function. Subsequently, we clarify the equivalence between regret minimization in dueling bandit and convex optimization for the cost function. Moreover, when considering a lower bound in convex optimization, our algorithm is shown to achieve the optimal convergence rate in convex optimization and the optimal regret in dueling bandit except for a logarithmic factor.
Submission history
From: Wataru Kumagai [view email][v1] Tue, 21 Nov 2017 09:58:00 GMT (36kb,D)
[v2] Tue, 12 Dec 2017 07:32:36 GMT (36kb,D)
Link back to: arXiv, form interface, contact.