We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: First-order optimization on stratified sets

Abstract: We consider the problem of minimizing a differentiable function with locally Lipschitz continuous gradient on a stratified set and present a first-order algorithm designed to find a stationary point of that problem. Our assumptions on the stratified set are satisfied notably by the determinantal variety (i.e., matrices of bounded rank), its intersection with the cone of positive-semidefinite matrices, and the set of nonnegative sparse vectors. The iteration map of the proposed algorithm applies a step of projected-projected gradient descent with backtracking line search, as proposed by Schneider and Uschmajew (2015), to its input but also to a projection of the input onto each of the lower strata to which it is considered close, and outputs a point among those thereby produced that maximally reduces the cost function. Under our assumptions on the stratified set, we prove that this algorithm produces a sequence whose accumulation points are stationary, and therefore does not follow the so-called apocalypses described by Levin, Kileel, and Boumal (2022). We illustrate the apocalypse-free property of our method through a numerical experiment on the determinantal variety.
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA)
MSC classes: 65K10, 49J53, 90C26, 90C46, 58A35, 14M12, 15B99
Cite as: arXiv:2303.16040 [math.OC]
  (or arXiv:2303.16040v1 [math.OC] for this version)

Submission history

From: Guillaume Olikier [view email]
[v1] Tue, 28 Mar 2023 15:16:11 GMT (258kb)

Link back to: arXiv, form interface, contact.