We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Asymptotic properties for combined $L_1$ and concave regularization

Abstract: Two important goals of high-dimensional modeling are prediction and variable selection. In this article, we consider regularization with combined $L_1$ and concave penalties, and study the sampling properties of the global optimum of the suggested method in ultra-high dimensional settings. The $L_1$-penalty provides the minimum regularization needed for removing noise variables in order to achieve oracle prediction risk, while concave penalty imposes additional regularization to control model sparsity. In the linear model setting, we prove that the global optimum of our method enjoys the same oracle inequalities as the lasso estimator and admits an explicit bound on the false sign rate, which can be asymptotically vanishing. Moreover, we establish oracle risk inequalities for the method and the sampling properties of computable solutions. Numerical studies suggest that our method yields more stable estimates than using a concave penalty alone.
Comments: 16 pages
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
MSC classes: 62J07(Primary) 62F07(Secondary)
Journal reference: Biometrika 101, 57-70
DOI: 10.1093/biomet/ast047
Cite as: arXiv:1605.03335 [stat.ME]
  (or arXiv:1605.03335v1 [stat.ME] for this version)

Submission history

From: Jinchi Lv [view email]
[v1] Wed, 11 May 2016 08:51:05 GMT (98kb)

Link back to: arXiv, form interface, contact.