We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.stat-mech

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Statistical Mechanics

Title: Large deviations of extreme eigenvalues of generalized sample covariance matrices

Abstract: We present an analytical technique to compute the probability of rare events in which the largest eigenvalue of a random matrix is atypically large (i.e.\ the right tail of its large deviations). The results also transfer to the left tail of the large deviations of the smallest eigenvalue. The technique improves upon past methods by not requiring the explicit law of the eigenvalues, and we apply it to a large class of random matrices that were previously out of reach. In particular, we solve an open problem related to the performance of principal components analysis on highly correlated data, and open the way towards analyzing the high-dimensional landscapes of complex inference models. We probe our results using an importance sampling approach, effectively simulating events with probability as small as $10^{-100}$.
Comments: 7 pages + 7 pages appendix. Updated version matching the published article
Subjects: Statistical Mechanics (cond-mat.stat-mech); Disordered Systems and Neural Networks (cond-mat.dis-nn); Probability (math.PR); Statistics Theory (math.ST)
DOI: 10.1209/0295-5075/133/20005
Cite as: arXiv:2008.09496 [cond-mat.stat-mech]
  (or arXiv:2008.09496v2 [cond-mat.stat-mech] for this version)

Submission history

From: Antoine Maillard [view email]
[v1] Fri, 21 Aug 2020 14:24:01 GMT (998kb,D)
[v2] Mon, 8 Feb 2021 14:22:10 GMT (1001kb,D)

Link back to: arXiv, form interface, contact.