We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: On Local Linear Convergence of Projected Gradient Descent for Unit-Modulus Least Squares

Abstract: The unit-modulus least squares (UMLS) problem has a wide spectrum of applications in signal processing, e.g., phase-only beamforming, phase retrieval, radar code design, and sensor network localization. Scalable first-order methods such as projected gradient descent (PGD) have recently been studied as a simple yet efficient approach to solving the UMLS problem. Existing results on the convergence of PGD for UMLS often focus on global convergence to stationary points. As a non-convex problem, only a sublinear convergence rate has been established. However, these results do not explain the fast convergence of PGD frequently observed in practice. This manuscript presents a novel analysis of convergence of PGD for UMLS, justifying the linear convergence behavior of the algorithm near the solution. By exploiting the local structure of the objective function and the constraint set, we establish an exact expression for the convergence rate and characterize the conditions for linear convergence. Simulations show that our theoretical analysis corroborates numerical examples. Furthermore, variants of PGD with adaptive step sizes are proposed based on the new insight revealed in our convergence analysis. The variants show substantial acceleration in practice.
Comments: 16 pages
Subjects: Optimization and Control (math.OC); Signal Processing (eess.SP)
Cite as: arXiv:2206.10832 [math.OC]
  (or arXiv:2206.10832v2 [math.OC] for this version)

Submission history

From: Trung Vu [view email]
[v1] Wed, 22 Jun 2022 04:16:04 GMT (3561kb)
[v2] Fri, 1 Jul 2022 05:59:56 GMT (504kb)

Link back to: arXiv, form interface, contact.