References & Citations
Statistics > Methodology
Title: Efficient Test-based Variable Selection for High-dimensional Linear Models
(Submitted on 12 Jun 2017 (v1), last revised 31 Jan 2018 (this version, v2))
Abstract: Variable selection plays a fundamental role in high-dimensional data analysis. Various methods have been developed for variable selection in recent years. Well-known examples are forward stepwise regression (FSR) and least angle regression (LARS), among others. These methods typically add variables into the model one by one. For such selection procedures, it is crucial to find a stopping criterion that controls model complexity. One of the most commonly used techniques to this end is cross-validation (CV) which, in spite of its popularity, has two major drawbacks: expensive computational cost and lack of statistical interpretation. To overcome these drawbacks, we introduce a flexible and efficient test-based variable selection approach that can be incorporated into any sequential selection procedure. The test, which is on the overall signal in the remaining inactive variables, is based on the maximal absolute partial correlation between the inactive variables and the response given active variables. We develop the asymptotic null distribution of the proposed test statistic as the dimension tends to infinity uniformly in the sample size. We also show that the test is consistent. With this test, at each step of the selection, a new variable is included if and only if the $p$-value is below some pre-defined level. Numerical studies show that the proposed method delivers very competitive performance in terms of variable selection accuracy and computational complexity compared to CV.
Submission history
From: Siliang Gong [view email][v1] Mon, 12 Jun 2017 04:17:25 GMT (38kb,D)
[v2] Wed, 31 Jan 2018 01:21:16 GMT (35kb,D)
Link back to: arXiv, form interface, contact.