We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Generalized Low-rank plus Sparse Tensor Estimation by Fast Riemannian Optimization

Abstract: We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or heterogeneous signals that are unexplainable by the low-rank part. The framework is flexible covering both linear and non-linear models, and can easily handle continuous or categorical variables. We propose a fast algorithm by integrating the Riemannian gradient descent and a novel gradient pruning procedure. Under suitable conditions, the algorithm converges linearly and can simultaneously estimate both the low-rank and sparse tensors. The statistical error bounds of final estimates are established in terms of the gradient of loss function. The error bounds are generally sharp under specific statistical models, e.g., the robust tensor PCA and the community detection in hypergraph networks with outlier vertices. Moreover, our method achieves non-trivial error bounds for heavy-tailed tensor PCA whenever the noise has a finite $2+\varepsilon$ moment. We apply our method to analyze the international trade flow dataset and the statistician hypergraph co-authorship network, both yielding new and interesting findings.
Comments: corrected typos - Mar. 23
Subjects: Methodology (stat.ME); Optimization and Control (math.OC); Statistics Theory (math.ST)
Cite as: arXiv:2103.08895 [stat.ME]
  (or arXiv:2103.08895v2 [stat.ME] for this version)

Submission history

From: Dong Xia [view email]
[v1] Tue, 16 Mar 2021 07:38:54 GMT (4786kb,D)
[v2] Tue, 23 Mar 2021 06:33:59 GMT (4784kb,D)

Link back to: arXiv, form interface, contact.