We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Nested Model Averaging on Solution Path for High-dimensional Linear Regression

Abstract: We study the nested model averaging method on the solution path for a high-dimensional linear regression problem. In particular, we propose to combine model averaging with regularized estimators (e.g., lasso and SLOPE) on the solution path for high-dimensional linear regression. In simulation studies, we first conduct a systematic investigation on the impact of predictor ordering on the behavior of nested model averaging, then show that nested model averaging with lasso and SLOPE compares favorably with other competing methods, including the infeasible lasso and SLOPE with the tuning parameter optimally selected. A real data analysis on predicting the per capita violent crime in the United States shows an outstanding performance of the nested model averaging with lasso.
Comments: 17 pages, 3 figures
Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Econometrics (econ.EM); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:2005.08057 [stat.ME]
  (or arXiv:2005.08057v1 [stat.ME] for this version)

Submission history

From: Yang Feng [view email]
[v1] Sat, 16 May 2020 18:09:57 GMT (711kb,D)

Link back to: arXiv, form interface, contact.