We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Best Arm Identification for Cascading Bandits in the Fixed Confidence Setting

Abstract: We design and analyze CascadeBAI, an algorithm for finding the best set of $K$ items, also called an arm, within the framework of cascading bandits. An upper bound on the time complexity of CascadeBAI is derived by overcoming a crucial analytical challenge, namely, that of probabilistically estimating the amount of available feedback at each step. To do so, we define a new class of random variables (r.v.'s) which we term as left-sided sub-Gaussian r.v.'s; these are r.v.'s whose cumulant generating functions (CGFs) can be bounded by a quadratic only for non-positive arguments of the CGFs. This enables the application of a sufficiently tight Bernstein-type concentration inequality. We show, through the derivation of a lower bound on the time complexity, that the performance of CascadeBAI is optimal in some practical regimes. Finally, extensive numerical simulations corroborate the efficacy of CascadeBAI as well as the tightness of our upper bound on its time complexity.
Comments: 39 pages, 25 figures. Proceedings of the 37th International Conference on Machine Learning (ICML), Vienna, Austria, PMLR 108, 2020
Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)
Cite as: arXiv:2001.08655 [cs.LG]
  (or arXiv:2001.08655v3 [cs.LG] for this version)

Submission history

From: Zixin Zhong [view email]
[v1] Thu, 23 Jan 2020 16:47:52 GMT (2468kb,D)
[v2] Fri, 24 Jan 2020 04:03:09 GMT (2468kb,D)
[v3] Mon, 15 Jun 2020 16:26:18 GMT (3659kb,D)

Link back to: arXiv, form interface, contact.