We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Lp and almost sure rates of convergence of averaged stochastic gradient algorithms: locally strongly convex objective

Abstract: An usual problem in statistics consists in estimating the minimizer of a convex function. When we have to deal with large samples taking values in high dimensional spaces, stochastic gradient algorithms and their averaged versions are efficient candidates. Indeed, (1) they do not need too much computational efforts, (2) they do not need to store all the data, which is crucial when we deal with big data, (3) they allow to simply update the estimates, which is important when data arrive sequentially. The aim of this work is to give asymptotic and non asymptotic rates of convergence of stochastic gradient estimates as well as of their averaged versions when the function we would like to minimize is only locally strongly convex.
Subjects: Statistics Theory (math.ST)
Cite as: arXiv:1609.05479 [math.ST]
  (or arXiv:1609.05479v3 [math.ST] for this version)

Submission history

From: Antoine Godichon-Baggioni [view email]
[v1] Sun, 18 Sep 2016 12:34:16 GMT (24kb)
[v2] Tue, 4 Jul 2017 09:12:27 GMT (23kb)
[v3] Tue, 11 Jan 2022 08:53:31 GMT (45kb,D)

Link back to: arXiv, form interface, contact.