We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Semi-parametric efficiency bounds for high-dimensional models

Abstract: Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models, where the dimension of the parameter is larger than the sample size. We adopt a semi-parametric point of view: we concentrate on one dimensional functions of a high-dimensional parameter. We follow two different approaches to reach the lower bounds: asymptotic Cram\'er-Rao bounds and Le Cam's type of analysis. Both these approaches allow us to define a class of asymptotically unbiased or "regular" estimators for which a lower bound is derived. Consequently, we show that certain estimators obtained by de-sparsifying (or de-biasing) an $\ell_1$-penalized M-estimator are asymptotically unbiased and achieve the lower bound on the variance: thus in this sense they are asymptotically efficient. The paper discusses in detail the linear regression model and the Gaussian graphical model.
Comments: 68 pages
Subjects: Statistics Theory (math.ST); Methodology (stat.ME)
Cite as: arXiv:1601.00815 [math.ST]
  (or arXiv:1601.00815v4 [math.ST] for this version)

Submission history

From: Jana Jankova [view email]
[v1] Tue, 5 Jan 2016 12:50:05 GMT (33kb)
[v2] Wed, 8 Jun 2016 16:47:30 GMT (95kb)
[v3] Fri, 4 Aug 2017 13:10:07 GMT (50kb)
[v4] Thu, 12 Oct 2017 20:43:50 GMT (82kb)

Link back to: arXiv, form interface, contact.