We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: ExSIS: Extended Sure Independence Screening for Ultrahigh-dimensional Linear Models

Abstract: Statistical inference can be computationally prohibitive in ultrahigh-dimensional linear models. Correlation-based variable screening, in which one leverages marginal correlations for removal of irrelevant variables from the model prior to statistical inference, can be used to overcome this challenge. Prior works on correlation-based variable screening either impose statistical priors on the linear model or assume specific post-screening inference methods. This paper first extends the analysis of correlation-based variable screening to arbitrary linear models and post-screening inference techniques. In particular, (i) it shows that a condition---termed the screening condition---is sufficient for successful correlation-based screening of linear models, and (ii) it provides insights into the dependence of marginal correlation-based screening on different problem parameters. Numerical experiments confirm that these insights are not mere artifacts of analysis; rather, they are reflective of the challenges associated with marginal correlation-based variable screening. Second, the paper explicitly derives the screening condition for arbitrary (random or deterministic) linear models and, in the process, it establishes that---under appropriate conditions---it is possible to reduce the dimension of an ultrahigh-dimensional, arbitrary linear model to almost the sample size even when the number of active variables scales almost linearly with the sample size. Third, it specializes the screening condition to sub-Gaussian linear models and contrasts the final results to those existing in the literature. This specialization formally validates the claim that the main result of this paper generalizes existing ones on correlation-based screening.
Comments: 30 pages; 3 figures and 1 table; preprint of a journal publication
Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (stat.ML)
Journal reference: EURASIP J. Signal Processing, vol. 159, pp. 33-48, Jun. 2019
DOI: 10.1016/j.sigpro.2019.01.018
Cite as: arXiv:1708.06077 [math.ST]
  (or arXiv:1708.06077v2 [math.ST] for this version)

Submission history

From: Waheed Bajwa [view email]
[v1] Mon, 21 Aug 2017 03:41:14 GMT (49kb)
[v2] Sat, 4 Jul 2020 18:48:20 GMT (78kb,D)

Link back to: arXiv, form interface, contact.