We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: The Sup-norm Perturbation of HOSVD and Low Rank Tensor Denoising

Authors: Dong Xia, Fan Zhou
Abstract: The higher order singular value decomposition (HOSVD) of tensors is a generalization of matrix SVD. The perturbation analysis of HOSVD under random noise is more delicate than its matrix counterpart. Recently, polynomial time algorithms have been proposed where statistically optimal estimates of the singular subspaces and the low rank tensors are attainable in the Euclidean norm. In this article, we analyze the sup-norm perturbation bounds of HOSVD and introduce estimators of the singular subspaces with sharp deviation bounds in the sup-norm. We also investigate a low rank tensor denoising estimator and demonstrate its fast convergence rate with respect to the entry-wise errors. The sup-norm perturbation bounds reveal unconventional phase transitions for statistical learning applications such as the exact clustering in high dimensional Gaussian mixture model and the exact support recovery in sub-tensor localizations. In addition, the bounds established for HOSVD also elaborate the one-sided sup-norm perturbation bounds for the singular subspaces of unbalanced (or fat) matrices.
Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Probability (math.PR); Machine Learning (stat.ML)
Cite as: arXiv:1707.01207 [math.ST]
  (or arXiv:1707.01207v5 [math.ST] for this version)

Submission history

From: Dong Xia [view email]
[v1] Wed, 5 Jul 2017 03:58:11 GMT (33kb,D)
[v2] Thu, 13 Jul 2017 01:39:33 GMT (33kb,D)
[v3] Sat, 21 Apr 2018 22:19:15 GMT (384kb)
[v4] Thu, 3 May 2018 15:38:51 GMT (406kb,D)
[v5] Tue, 1 Jan 2019 09:53:59 GMT (159kb,D)

Link back to: arXiv, form interface, contact.