We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: The radius of statistical efficiency

Abstract: Classical results in asymptotic statistics show that the Fisher information matrix controls the difficulty of estimating a statistical model from observed data. In this work, we introduce a companion measure of robustness of an estimation problem: the radius of statistical efficiency (RSE) is the size of the smallest perturbation to the problem data that renders the Fisher information matrix singular. We compute RSE up to numerical constants for a variety of test bed problems, including principal component analysis, generalized linear models, phase retrieval, bilinear sensing, and matrix completion. In all cases, the RSE quantifies the compatibility between the covariance of the population data and the latent model parameter. Interestingly, we observe a precise reciprocal relationship between RSE and the intrinsic complexity/sensitivity of the problem instance, paralleling the classical Eckart-Young theorem in numerical analysis.
Subjects: Statistics Theory (math.ST); Optimization and Control (math.OC); Machine Learning (stat.ML)
MSC classes: 90C15, 49K40, 62F12, 90C31
Cite as: arXiv:2405.09676 [math.ST]
  (or arXiv:2405.09676v1 [math.ST] for this version)

Submission history

From: Mateo Díaz [view email]
[v1] Wed, 15 May 2024 19:36:08 GMT (77kb)

Link back to: arXiv, form interface, contact.