We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Tight Regret Bounds for Infinite-armed Linear Contextual Bandits

Abstract: Linear contextual bandit is an important class of sequential decision making problems with a wide range of applications to recommender systems, online advertising, healthcare, and many other machine learning related tasks. While there is a lot of prior research, tight regret bounds of linear contextual bandit with infinite action sets remain open. In this paper, we address this open problem by considering the linear contextual bandit with (changing) infinite action sets. We prove a regret upper bound on the order of $O(\sqrt{d^2T\log T})\times \text{poly}(\log\log T)$ where $d$ is the domain dimension and $T$ is the time horizon. Our upper bound matches the previous lower bound of $\Omega(\sqrt{d^2 T\log T})$ in [Li et al., 2019] up to iterated logarithmic terms.
Comments: 10 pages, accepted for presentation at AISTATS 2021
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:1905.01435 [stat.ML]
  (or arXiv:1905.01435v3 [stat.ML] for this version)

Submission history

From: Yuan Zhou [view email]
[v1] Sat, 4 May 2019 05:51:30 GMT (20kb)
[v2] Sat, 23 Jan 2021 18:29:23 GMT (237kb)
[v3] Tue, 26 Jan 2021 23:55:53 GMT (237kb)

Link back to: arXiv, form interface, contact.