We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: An adaptive stochastic optimization algorithm for resource allocation

Abstract: We consider the classical problem of sequential resource allocation where a decision maker must repeatedly divide a budget between several resources, each with diminishing returns. This can be recast as a specific stochastic optimization problem where the objective is to maximize the cumulative reward, or equivalently to minimize the regret. We construct an algorithm that is {\em adaptive} to the complexity of the problem, expressed in term of the regularity of the returns of the resources, measured by the exponent in the {\L}ojasiewicz inequality (or by their universal concavity parameter). Our parameter-independent algorithm recovers the optimal rates for strongly-concave functions and the classical fast rates of multi-armed bandit (for linear reward functions). Moreover, the algorithm improves existing results on stochastic optimization in this regret minimization setting for intermediate cases.
Comments: ALT2020, 45 pages, 9 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)
Journal reference: Proceedings of Machine Learning Research (PMLR), volume 117, 2020
Cite as: arXiv:1902.04376 [stat.ML]
  (or arXiv:1902.04376v3 [stat.ML] for this version)

Submission history

From: Xavier Fontaine [view email]
[v1] Tue, 12 Feb 2019 13:26:26 GMT (121kb)
[v2] Wed, 5 Jun 2019 14:39:09 GMT (130kb)
[v3] Thu, 16 Jan 2020 09:38:20 GMT (157kb)

Link back to: arXiv, form interface, contact.