References & Citations
Statistics > Computation
Title: Lasso, fractional norm and structured sparse estimation using a Hadamard product parametrization
(Submitted on 31 Oct 2016 (this version), latest version 19 May 2017 (v2))
Abstract: Using a multiplicative reparametrization, I show that a subclass of $L_q$ penalties with $q\leq 1$ can be expressed as sums of $L_2$ penalties. It follows that the lasso and other norm-penalized regression estimates may be obtained using a very simple and intuitive alternating ridge regression algorithm. As compared to a similarly intuitive EM algorithm for $L_q$ optimization, the proposed algorithm avoids some numerical instability issues and is also competitive in terms of speed. Furthermore, the proposed algorithm is easily extendable to generalized linear models, and can be used to create structured sparsity via penalties derived from covariance models for the parameters. Such model-based penalties may be useful for sparse estimation of spatially or temporally structured parameters.
Submission history
From: Peter Hoff [view email][v1] Mon, 31 Oct 2016 20:52:27 GMT (57kb,D)
[v2] Fri, 19 May 2017 00:48:33 GMT (77kb,D)
Link back to: arXiv, form interface, contact.