We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Interaction pursuit in high-dimensional multi-response regression via distance correlation

Abstract: Feature interactions can contribute to a large proportion of variation in many prediction models. In the era of big data, the coexistence of high dimensionality in both responses and covariates poses unprecedented challenges in identifying important interactions. In this paper, we suggest a two-stage interaction identification method, called the interaction pursuit via distance correlation (IPDC), in the setting of high-dimensional multi-response interaction models that exploits feature screening applied to transformed variables with distance correlation followed by feature selection. Such a procedure is computationally efficient, generally applicable beyond the heredity assumption, and effective even when the number of responses diverges with the sample size. Under mild regularity conditions, we show that this method enjoys nice theoretical properties including the sure screening property, support union recovery, and oracle inequalities in prediction and estimation for both interactions and main effects. The advantages of our method are supported by several simulation studies and real data analysis.
Comments: to appear in The Annals of Statistics (2016)
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
MSC classes: 62H12, 62J02 (Primary), 62F07, 62F12 (Secondary)
Cite as: arXiv:1605.03315 [stat.ME]
  (or arXiv:1605.03315v1 [stat.ME] for this version)

Submission history

From: Jinchi Lv [view email]
[v1] Wed, 11 May 2016 08:03:14 GMT (127kb,D)

Link back to: arXiv, form interface, contact.