We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Low-Rank Univariate Sum of Squares Has No Spurious Local Minima

Abstract: We study the problem of decomposing a polynomial $p$ into a sum of $r$ squares by minimizing a quadratically penalized objective $f_p(\mathbf{u}) = \left\lVert \sum_{i=1}^r u_i^2 - p\right\lVert^2$. This objective is nonconvex and is equivalent to the rank-$r$ Burer-Monteiro factorization of a semidefinite program (SDP) encoding the sum of squares decomposition. We show that for all univariate polynomials $p$, if $r \ge 2$ then $f_p(\mathbf{u})$ has no spurious second-order critical points, showing that all local optima are also global optima. This is in contrast to previous work showing that for general SDPs, in addition to genericity conditions, $r$ has to be roughly the square root of the number of constraints (the degree of $p$) for there to be no spurious second-order critical points. Our proof uses tools from computational algebraic geometry and can be interpreted as constructing a certificate using the first- and second-order necessary conditions. We also show that by choosing a norm based on sampling equally-spaced points on the circle, the gradient $\nabla f_p$ can be computed in nearly linear time using fast Fourier transforms. Experimentally we demonstrate that this method has very fast convergence using first-order optimization algorithms such as L-BFGS, with near-linear scaling to million-degree polynomials.
Comments: 18 pages, to appear in SIAM Journal on Optimization
Subjects: Optimization and Control (math.OC); Algebraic Geometry (math.AG); Numerical Analysis (math.NA)
MSC classes: 90C23, 90C26, 90C22
ACM classes: G.1.6; F.2.1
Journal reference: SIAM Journal on Optimization, Vol. 33, Iss. 3 (2023)
DOI: 10.1137/22M1516208
Cite as: arXiv:2205.11466 [math.OC]
  (or arXiv:2205.11466v2 [math.OC] for this version)

Submission history

From: Chenyang Yuan [view email]
[v1] Mon, 23 May 2022 17:03:16 GMT (145kb,D)
[v2] Fri, 7 Jul 2023 13:44:40 GMT (173kb,D)

Link back to: arXiv, form interface, contact.