Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Semi-standard partial covariance variable selection when irrepresentable conditions fail
(Submitted on 14 Sep 2017 (v1), last revised 24 Apr 2022 (this version, v2))
Abstract: Traditional variable selection methods could fail to be sign consistent when irrepresentable conditions are violated. This is especially critical in high-dimensional settings when the number of predictors exceeds the sample size. In this paper, we propose a new semi-standard partial covariance (SPAC) approach which is capable of reducing correlation effects from other covariates while fully capturing the magnitude of coefficients. The proposed SPAC is effective in choosing covariates which have direct effects on the response variable, while eliminating the predictors which are not directly associated with the response but are highly correlated with the relevant predictors. We show that the proposed SPAC method with the Lasso penalty or the smoothly clipped absolute deviation (SCAD) penalty possesses strong sign consistency in high-dimensional settings. Numerical studies and a post-traumatic stress disorder data application also confirm that the proposed method outperforms the existing Lasso, adaptive Lasso, SCAD, Peter-Clark-simple algorithm, and factor-adjusted regularized model selection methods when the irrepresentable conditions fail.
Submission history
From: Fei Xue [view email][v1] Thu, 14 Sep 2017 15:28:04 GMT (230kb,D)
[v2] Sun, 24 Apr 2022 22:45:21 GMT (394kb,D)
Link back to: arXiv, form interface, contact.