We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: A large covariance matrix estimator under intermediate spikiness regimes

Abstract: The present paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered by least squares minimization under nuclear norm plus $l_1$ norm penalization. This paper proposes a new estimator of that family based on an additional least-squares re-optimization step aimed at un-shrinking the eigenvalues of the low rank component estimated at the first step. We prove that such un-shrinkage causes the final estimate to approach the target as closely as possible in Frobenius norm while recovering exactly the underlying low rank and sparsity pattern. Consistency is guaranteed when $n$ is at least $O(p^{\frac{3}{2}\delta})$, provided that the maximum number of non-zeros per row in the sparse component is $O(p^{\delta})$ with $\delta \leq \frac{1}{2}$. Consistent recovery is ensured if the latent eigenvalues scale to $p^{\alpha}$, $\alpha \in[0,1]$, while rank consistency is ensured if $\delta \leq \alpha$. The resulting estimator is called UNALCE (UNshrunk ALgebraic Covariance Estimator) and is shown to outperform state of the art estimators, especially for what concerns fitting properties and sparsity pattern detection. The effectiveness of UNALCE is highlighted on a real example regarding ECB banking supervisory data.
Subjects: Methodology (stat.ME)
MSC classes: 62H25, 65F50, 15A18, 65F22
DOI: 10.1016/j.jmva.2019.104577
Cite as: arXiv:1711.08950 [stat.ME]
  (or arXiv:1711.08950v4 [stat.ME] for this version)

Submission history

From: Matteo Farnè Dr. [view email]
[v1] Fri, 24 Nov 2017 12:57:34 GMT (341kb)
[v2] Tue, 28 Nov 2017 21:25:47 GMT (341kb)
[v3] Wed, 21 Feb 2018 09:44:43 GMT (341kb)
[v4] Sat, 20 Oct 2018 17:59:56 GMT (363kb)

Link back to: arXiv, form interface, contact.