We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Combining Adversarial Guarantees and Stochastic Fast Rates in Online Learning

Abstract: We consider online learning algorithms that guarantee worst-case regret rates in adversarial environments (so they can be deployed safely and will perform robustly), yet adapt optimally to favorable stochastic environments (so they will perform well in a variety of settings of practical importance). We quantify the friendliness of stochastic environments by means of the well-known Bernstein (a.k.a. generalized Tsybakov margin) condition. For two recent algorithms (Squint for the Hedge setting and MetaGrad for online convex optimization) we show that the particular form of their data-dependent individual-sequence regret guarantees implies that they adapt automatically to the Bernstein parameters of the stochastic environment. We prove that these algorithms attain fast rates in their respective settings both in expectation and with high probability.
Subjects: Machine Learning (cs.LG)
Journal reference: Advances in Neural Information Processing Systems 29 (NeurIPS), 4457-4465, 2016
Cite as: arXiv:1605.06439 [cs.LG]
  (or arXiv:1605.06439v1 [cs.LG] for this version)

Submission history

From: Wouter Koolen [view email]
[v1] Fri, 20 May 2016 17:05:55 GMT (24kb)

Link back to: arXiv, form interface, contact.