Current browse context:
quant-ph
Change to browse by:
References & Citations
Quantum Physics
Title: Quantum exploration algorithms for multi-armed bandits
(Submitted on 14 Jul 2020 (v1), last revised 15 Dec 2020 (this version, v2))
Abstract: Identifying the best arm of a multi-armed bandit is a central problem in bandit optimization. We study a quantum computational version of this problem with coherent oracle access to states encoding the reward probabilities of each arm as quantum amplitudes. Specifically, we show that we can find the best arm with fixed confidence using $\tilde{O}\bigl(\sqrt{\sum_{i=2}^n\Delta^{\smash{-2}}_i}\bigr)$ quantum queries, where $\Delta_{i}$ represents the difference between the mean reward of the best arm and the $i^\text{th}$-best arm. This algorithm, based on variable-time amplitude amplification and estimation, gives a quadratic speedup compared to the best possible classical result. We also prove a matching quantum lower bound (up to poly-logarithmic factors).
Submission history
From: Tongyang Li [view email][v1] Tue, 14 Jul 2020 14:15:20 GMT (28kb)
[v2] Tue, 15 Dec 2020 18:31:01 GMT (41kb)
Link back to: arXiv, form interface, contact.