We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Convergence of the Forward-Backward Algorithm: Beyond the Worst Case with the Help of Geometry

Abstract: We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or {\L}ojasiewicz properties. These geometrical notions are usually local by nature, and may fail to describe the fine geometry of objective functions relevant in inverse problems and signal processing, that have a nice behaviour on manifolds, or sets open with respect to a weak topology. Motivated by this observation, we revisit those geometric notions over arbitrary sets. In turn, this allows us to present several new results as well as collect in a unified view a variety of results scattered in the literature. Our contributions include the analysis of infinite dimensional convex minimization problems, showing the first {\L}ojasiewicz inequality for a quadratic function associated to a compact operator, and the derivation of new linear rates for problems arising from inverse problems with low-complexity priors. Our approach allows to establish unexpected connections between geometry and a priori conditions in inverse problems, such as source conditions, or restricted isometry properties.
Comments: After peer-review, the paper has been significantly modified: i) Section 3.3 has been completely rewritten, and contains a new sum rule (Theorem 3.15) ii) The end of Section 4.2 and Section 5.2 have been rewritten to include mirror-stratifiable problems iii) The Annex contains new proofs for small-but-not-trivial claims made throughout the paper iv) Theorems, Examples etc have been renumbered
Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)
Journal reference: Math. Program. 198, 937-996 (2023)
DOI: 10.1007/s10107-022-01809-4
Cite as: arXiv:1703.09477 [math.OC]
  (or arXiv:1703.09477v4 [math.OC] for this version)

Submission history

From: Guillaume Garrigos [view email]
[v1] Tue, 28 Mar 2017 09:40:30 GMT (63kb)
[v2] Wed, 29 Mar 2017 10:40:02 GMT (64kb)
[v3] Tue, 1 Aug 2017 14:57:43 GMT (43kb)
[v4] Fri, 13 Nov 2020 15:44:39 GMT (59kb)

Link back to: arXiv, form interface, contact.