We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: The Hessian Screening Rule

Abstract: Predictor screening rules, which discard predictors before fitting a model, have had considerable impact on the speed with which sparse regression problems, such as the lasso, can be solved. In this paper we present a new screening rule for solving the lasso path: the Hessian Screening Rule. The rule uses second-order information from the model to provide both effective screening, particularly in the case of high correlation, as well as accurate warm starts. The proposed rule outperforms all alternatives we study on simulated data sets with both low and high correlation for $\ell_1$-regularized least-squares (the lasso) and logistic regression. It also performs best in general on the real data sets that we examine.
Comments: 25 pages, 14 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)
MSC classes: 62J07
ACM classes: G.3; G.4
Cite as: arXiv:2104.13026 [stat.ML]
  (or arXiv:2104.13026v3 [stat.ML] for this version)

Submission history

From: Johan Larsson [view email]
[v1] Tue, 27 Apr 2021 07:55:29 GMT (752kb,D)
[v2] Fri, 28 Jan 2022 12:55:56 GMT (777kb,D)
[v3] Tue, 4 Oct 2022 09:09:38 GMT (894kb,D)

Link back to: arXiv, form interface, contact.