Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Disagreement-Based Combinatorial Pure Exploration: Sample Complexity Bounds and an Efficient Algorithm
(Submitted on 21 Nov 2017 (v1), last revised 28 May 2019 (this version, v4))
Abstract: We design new algorithms for the combinatorial pure exploration problem in the multi-arm bandit framework. In this problem, we are given $K$ distributions and a collection of subsets $\mathcal{V} \subset 2^{[K]}$ of these distributions, and we would like to find the subset $v \in \mathcal{V}$ that has largest mean, while collecting, in a sequential fashion, as few samples from the distributions as possible. In both the fixed budget and fixed confidence settings, our algorithms achieve new sample-complexity bounds that provide polynomial improvements on previous results in some settings. Via an information-theoretic lower bound, we show that no approach based on uniform sampling can improve on ours in any regime, yielding the first interactive algorithms for this problem with this basic property. Computationally, we show how to efficiently implement our fixed confidence algorithm whenever $\mathcal{V}$ supports efficient linear optimization. Our results involve precise concentration-of-measure arguments and a new algorithm for linear programming with exponentially many constraints.
Submission history
From: Akshay Krishnamurthy [view email][v1] Tue, 21 Nov 2017 20:16:35 GMT (41kb,D)
[v2] Thu, 30 Nov 2017 12:44:57 GMT (41kb,D)
[v3] Mon, 4 Feb 2019 15:04:12 GMT (53kb,D)
[v4] Tue, 28 May 2019 12:59:42 GMT (53kb,D)
Link back to: arXiv, form interface, contact.