Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: An Information-Theoretic Analysis for Thompson Sampling with Many Actions
(Submitted on 30 May 2018 (v1), last revised 8 Jul 2020 (this version, v4))
Abstract: Information-theoretic Bayesian regret bounds of Russo and Van Roy capture the dependence of regret on prior uncertainty. However, this dependence is through entropy, which can become arbitrarily large as the number of actions increases. We establish new bounds that depend instead on a notion of rate-distortion. Among other things, this allows us to recover through information-theoretic arguments a near-optimal bound for the linear bandit. We also offer a bound for the logistic bandit that dramatically improves on the best previously available, though this bound depends on an information-theoretic statistic that we have only been able to quantify via computation.
Submission history
From: Shi Dong [view email][v1] Wed, 30 May 2018 07:56:40 GMT (529kb,D)
[v2] Mon, 4 Jun 2018 03:15:46 GMT (529kb,D)
[v3] Mon, 1 Oct 2018 17:09:47 GMT (529kb,D)
[v4] Wed, 8 Jul 2020 02:16:21 GMT (529kb,D)
Link back to: arXiv, form interface, contact.