Current browse context:
stat
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Semi-parametric efficiency bounds for high-dimensional models
(Submitted on 5 Jan 2016 (v1), last revised 12 Oct 2017 (this version, v4))
Abstract: Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models, where the dimension of the parameter is larger than the sample size. We adopt a semi-parametric point of view: we concentrate on one dimensional functions of a high-dimensional parameter. We follow two different approaches to reach the lower bounds: asymptotic Cram\'er-Rao bounds and Le Cam's type of analysis. Both these approaches allow us to define a class of asymptotically unbiased or "regular" estimators for which a lower bound is derived. Consequently, we show that certain estimators obtained by de-sparsifying (or de-biasing) an $\ell_1$-penalized M-estimator are asymptotically unbiased and achieve the lower bound on the variance: thus in this sense they are asymptotically efficient. The paper discusses in detail the linear regression model and the Gaussian graphical model.
Submission history
From: Jana Jankova [view email][v1] Tue, 5 Jan 2016 12:50:05 GMT (33kb)
[v2] Wed, 8 Jun 2016 16:47:30 GMT (95kb)
[v3] Fri, 4 Aug 2017 13:10:07 GMT (50kb)
[v4] Thu, 12 Oct 2017 20:43:50 GMT (82kb)
Link back to: arXiv, form interface, contact.