We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Lasso, fractional norm and structured sparse estimation using a Hadamard product parametrization

Authors: Peter D. Hoff
Abstract: Using a multiplicative reparametrization, I show that a subclass of $L_q$ penalties with $q\leq 1$ can be expressed as sums of $L_2$ penalties. It follows that the lasso and other norm-penalized regression estimates may be obtained using a very simple and intuitive alternating ridge regression algorithm. As compared to a similarly intuitive EM algorithm for $L_q$ optimization, the proposed algorithm avoids some numerical instability issues and is also competitive in terms of speed. Furthermore, the proposed algorithm is easily extendable to generalized linear models, and can be used to create structured sparsity via penalties derived from covariance models for the parameters. Such model-based penalties may be useful for sparse estimation of spatially or temporally structured parameters.
Subjects: Computation (stat.CO)
MSC classes: 62-04
Cite as: arXiv:1611.00040 [stat.CO]
  (or arXiv:1611.00040v1 [stat.CO] for this version)

Submission history

From: Peter Hoff [view email]
[v1] Mon, 31 Oct 2016 20:52:27 GMT (57kb,D)
[v2] Fri, 19 May 2017 00:48:33 GMT (77kb,D)

Link back to: arXiv, form interface, contact.