We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: On Stein's Identity and Near-Optimal Estimation in High-dimensional Index Models

Abstract: We consider estimating the parametric components of semi-parametric multiple index models in a high-dimensional and non-Gaussian setting. Such models form a rich class of non-linear models with applications to signal processing, machine learning and statistics. Our estimators leverage the score function based first and second-order Stein's identities and do not require the covariates to satisfy Gaussian or elliptical symmetry assumptions common in the literature. Moreover, to handle score functions and responses that are heavy-tailed, our estimators are constructed via carefully thresholding their empirical counterparts. We show that our estimator achieves near-optimal statistical rate of convergence in several settings. We supplement our theoretical results via simulation experiments that confirm the theory.
Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:1709.08795 [math.ST]
  (or arXiv:1709.08795v2 [math.ST] for this version)

Submission history

From: Krishnakumar Balasubramanian [view email]
[v1] Tue, 26 Sep 2017 03:04:11 GMT (270kb,D)
[v2] Tue, 17 Jul 2018 22:48:08 GMT (271kb,D)

Link back to: arXiv, form interface, contact.