Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Ensemble-based estimates of eigenvector error for empirical covariance matrices
(Submitted on 28 Dec 2016 (this version), latest version 28 Feb 2018 (v2))
Abstract: Covariance matrices are fundamental to the analysis and forecast of economic, physical and biological systems. Although the eigenvalues $\{\lambda_i\}$ and eigenvectors $\{\bf{u}_i\}$ of a covariance matrix are central to such endeavors, in practice one must inevitably approximate the covariance matrix based on data with finite sample size $n$ to obtain empirical eigenvalues $\{\tilde{\lambda}_i\}$ and eigenvectors $\{\tilde{\bf{u}}_i\}$, and therefore understanding the error so introduced is of central importance. We analyze eigenvector error $\|\bf{u}_i - \tilde{\bf{u}}_i \|^2$ while leveraging the assumption that the true covariance matrix is drawn from an ensemble with known spectral properties, such as the distribution of and the gaps between eigenvalues. This approach complements previous analyses of eigenvector error that require the full set of eigenvalues to be known. In particular, we study the distribution of the expected square error $r= \mathbb{E}\left[\| \bf{u}_i - \tilde{\bf{u}}_i \|^2\right]$ across the matrix ensemble for eigenvalues near a particular value $\lambda$ and, for example, find for sufficiently large matrix size $p$ and sample size $n$ that the probability density of the squared error decays as $1/nr^2$. We support this and further results with numerical experiments.
Submission history
From: Dane Taylor [view email][v1] Wed, 28 Dec 2016 05:04:35 GMT (1306kb,D)
[v2] Wed, 28 Feb 2018 19:40:23 GMT (1085kb,D)
Link back to: arXiv, form interface, contact.