Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: On Stein's Identity and Near-Optimal Estimation in High-dimensional Index Models
(Submitted on 26 Sep 2017 (v1), last revised 17 Jul 2018 (this version, v2))
Abstract: We consider estimating the parametric components of semi-parametric multiple index models in a high-dimensional and non-Gaussian setting. Such models form a rich class of non-linear models with applications to signal processing, machine learning and statistics. Our estimators leverage the score function based first and second-order Stein's identities and do not require the covariates to satisfy Gaussian or elliptical symmetry assumptions common in the literature. Moreover, to handle score functions and responses that are heavy-tailed, our estimators are constructed via carefully thresholding their empirical counterparts. We show that our estimator achieves near-optimal statistical rate of convergence in several settings. We supplement our theoretical results via simulation experiments that confirm the theory.
Submission history
From: Krishnakumar Balasubramanian [view email][v1] Tue, 26 Sep 2017 03:04:11 GMT (270kb,D)
[v2] Tue, 17 Jul 2018 22:48:08 GMT (271kb,D)
Link back to: arXiv, form interface, contact.