We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Relating lp regularization and reweighted l1 regularization

Abstract: We propose a general framework of iteratively reweighted l1 methods for solving lp regularization problems. We prove that after some iteration k, the iterates generated by the proposed methods have the same support and sign as the limit points, and are bounded away from 0, so that the algorithm behaves like solving a smooth problem in the reduced space. As a result, the global convergence can be easily obtained and an update strategy for the smoothing parameter is proposed which can automatically terminate the updates for zero components. We show that lp regularization problems are locally equivalent to a weighted l1 regularization problem and every optimal point corresponds to a Maximum A Posterior estimation for independently and non-identically distributed Laplace prior parameters. Numerical experiments exhibit the behaviors and the efficiency of our proposed methods.
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
Cite as: arXiv:1912.00723 [math.OC]
  (or arXiv:1912.00723v1 [math.OC] for this version)

Submission history

From: Hao Wang [view email]
[v1] Mon, 2 Dec 2019 12:47:28 GMT (247kb,D)

Link back to: arXiv, form interface, contact.