We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: A convergence framework for inexact nonconvex and nonsmooth algorithms and its applications to several iterations

Abstract: In this paper, we consider the convergence of an abstract inexact nonconvex and nonsmooth algorithm. We promise a pseudo sufficient descent condition and a pseudo relative error condition, which are both related to an auxiliary sequence, for the algorithm; and a continuity condition is assumed to hold. In fact, a lot of classical inexact nonconvex and nonsmooth algorithms allow these three conditions. Under a special kind of summable assumption on the auxiliary sequence, we prove the sequence generated by the general algorithm converges to a critical point of the objective function if being assumed Kurdyka- Lojasiewicz property. The core of the proofs lies in building a new Lyapunov function, whose successive difference provides a bound for the successive difference of the points generated by the algorithm. And then, we apply our findings to several classical nonconvex iterative algorithms and derive the corresponding convergence results
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA); Machine Learning (stat.ML)
Cite as: arXiv:1709.04072 [math.OC]
  (or arXiv:1709.04072v6 [math.OC] for this version)

Submission history

From: Tao Sun [view email]
[v1] Tue, 12 Sep 2017 22:28:18 GMT (21kb)
[v2] Mon, 5 Mar 2018 03:37:57 GMT (21kb)
[v3] Tue, 6 Mar 2018 03:19:48 GMT (21kb)
[v4] Wed, 23 May 2018 19:34:11 GMT (21kb)
[v5] Fri, 10 Aug 2018 21:26:28 GMT (27kb,D)
[v6] Wed, 28 Nov 2018 02:40:16 GMT (41kb,D)

Link back to: arXiv, form interface, contact.