We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Local Minimax Complexity of Stochastic Convex Optimization

Abstract: We extend the traditional worst-case, minimax analysis of stochastic convex optimization by introducing a localized form of minimax complexity for individual functions. Our main result gives function-specific lower and upper bounds on the number of stochastic subgradient evaluations needed to optimize either the function or its "hardest local alternative" to a given numerical precision. The bounds are expressed in terms of a localized and computational analogue of the modulus of continuity that is central to statistical minimax analysis. We show how the computational modulus of continuity can be explicitly calculated in concrete cases, and relates to the curvature of the function at the optimum. We also prove a superefficiency result that demonstrates it is a meaningful benchmark, acting as a computational analogue of the Fisher information in statistical estimation. The nature and practical implications of the results are demonstrated in simulations.
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1605.07596 [stat.ML]
  (or arXiv:1605.07596v3 [stat.ML] for this version)

Submission history

From: Yuancheng Zhu [view email]
[v1] Tue, 24 May 2016 19:37:41 GMT (60kb,D)
[v2] Wed, 25 May 2016 15:43:36 GMT (60kb,D)
[v3] Thu, 26 May 2016 16:07:37 GMT (60kb,D)

Link back to: arXiv, form interface, contact.