We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Numerical tolerance for spectral decompositions of random matrices

Abstract: We precisely quantify the impact of statistical error in the quality of a numerical approximation to a random matrix eigendecomposition, and under mild conditions, we use this to introduce an optimal numerical tolerance for residual error in spectral decompositions of random matrices. We demonstrate that terminating an eigendecomposition algorithm when the numerical error and statistical error are of the same order results in computational savings with no loss of accuracy. We also repair a flaw in a ubiquitous termination condition, one in wide employ in several computational linear algebra implementations. We illustrate the practical consequences of our stopping criterion with an analysis of simulated and real networks. Our theoretical results and real-data examples establish that the tradeoff between statistical and numerical error is of significant import for data science.
Comments: 20 pages, 2 figures
Subjects: Computation (stat.CO); Numerical Analysis (math.NA)
MSC classes: 15, 62, 65
Cite as: arXiv:1608.00451 [stat.CO]
  (or arXiv:1608.00451v3 [stat.CO] for this version)

Submission history

From: Avanti Athreya [view email]
[v1] Mon, 1 Aug 2016 14:46:02 GMT (53kb,D)
[v2] Wed, 14 Jun 2017 16:37:56 GMT (47kb,D)
[v3] Fri, 31 Jan 2020 00:09:09 GMT (93kb,D)

Link back to: arXiv, form interface, contact.