We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: An Iteratively Reweighted Method for Sparse Optimization on Nonconvex $\ell_{p}$ Ball

Abstract: This paper is intended to solve the nonconvex $\ell_{p}$-ball constrained nonlinear optimization problems. An iteratively reweighted method is proposed, which solves a sequence of weighted $\ell_{1}$-ball projection subproblems. At each iteration, the next iterate is obtained by moving along the negative gradient with a stepsize and then projecting the resulted point onto the weighted $\ell_{1}$ ball to approximate the $\ell_{p}$ ball. Specifically, if the current iterate is in the interior of the feasible set, then the weighted $\ell_{1}$ ball is formed by linearizing the $\ell_{p}$ norm at the current iterate. If the current iterate is on the boundary of the feasible set, then the weighted $\ell_{1}$ ball is formed differently by keeping those zero components in the current iterate still zero. In our analysis, we prove that the generated iterates converge to a first-order stationary point. Numerical experiments demonstrate the effectiveness of the proposed method.
Comments: This work has been submitted and may be published. Copyright may be transferred without notice, after which this version may no longer be accessible
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
Cite as: arXiv:2104.02912 [math.OC]
  (or arXiv:2104.02912v1 [math.OC] for this version)

Submission history

From: Xiangyu Yang [view email]
[v1] Wed, 7 Apr 2021 04:43:36 GMT (33kb,D)

Link back to: arXiv, form interface, contact.