Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Convergence of the Forward-Backward Algorithm: Beyond the Worst Case with the Help of Geometry
(Submitted on 28 Mar 2017 (v1), last revised 13 Nov 2020 (this version, v4))
Abstract: We provide a comprehensive study of the convergence of the forward-backward algorithm under suitable geometric conditions, such as conditioning or {\L}ojasiewicz properties. These geometrical notions are usually local by nature, and may fail to describe the fine geometry of objective functions relevant in inverse problems and signal processing, that have a nice behaviour on manifolds, or sets open with respect to a weak topology. Motivated by this observation, we revisit those geometric notions over arbitrary sets. In turn, this allows us to present several new results as well as collect in a unified view a variety of results scattered in the literature. Our contributions include the analysis of infinite dimensional convex minimization problems, showing the first {\L}ojasiewicz inequality for a quadratic function associated to a compact operator, and the derivation of new linear rates for problems arising from inverse problems with low-complexity priors. Our approach allows to establish unexpected connections between geometry and a priori conditions in inverse problems, such as source conditions, or restricted isometry properties.
Submission history
From: Guillaume Garrigos [view email][v1] Tue, 28 Mar 2017 09:40:30 GMT (63kb)
[v2] Wed, 29 Mar 2017 10:40:02 GMT (64kb)
[v3] Tue, 1 Aug 2017 14:57:43 GMT (43kb)
[v4] Fri, 13 Nov 2020 15:44:39 GMT (59kb)
Link back to: arXiv, form interface, contact.