We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

Abstract: Feature selection is an important and active research area in statistics and machine learning. The Elastic Net is often used to perform selection when the features present non-negligible collinearity or practitioners wish to incorporate additional known structure. In this article, we propose a new Semi-smooth Newton Augmented Lagrangian Method to efficiently solve the Elastic Net in ultra-high dimensional settings. Our new algorithm exploits both the sparsity induced by the Elastic Net penalty and the sparsity due to the second order information of the augmented Lagrangian. This greatly reduces the computational cost of the problem. Using simulations on both synthetic and real datasets, we demonstrate that our approach outperforms its best competitors by at least an order of magnitude in terms of CPU time. We also apply our approach to a Genome Wide Association Study on childhood obesity.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)
MSC classes: 62J07
ACM classes: G.3
Cite as: arXiv:2006.03970 [stat.ML]
  (or arXiv:2006.03970v1 [stat.ML] for this version)

Submission history

From: Tobia Boschi [view email]
[v1] Sat, 6 Jun 2020 20:42:53 GMT (88kb,D)

Link back to: arXiv, form interface, contact.