We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Uncertainty quantification for nonconvex tensor completion: Confidence intervals, heteroscedasticity and optimality

Abstract: We study the distribution and uncertainty of nonconvex optimization for noisy tensor completion -- the problem of estimating a low-rank tensor given incomplete and corrupted observations of its entries. Focusing on a two-stage estimation algorithm proposed by Cai et al. (2019), we characterize the distribution of this nonconvex estimator down to fine scales. This distributional theory in turn allows one to construct valid and short confidence intervals for both the unseen tensor entries and the unknown tensor factors. The proposed inferential procedure enjoys several important features: (1) it is fully adaptive to noise heteroscedasticity, and (2) it is data-driven and automatically adapts to unknown noise distributions. Furthermore, our findings unveil the statistical optimality of nonconvex tensor completion: it attains un-improvable $\ell_{2}$ accuracy -- including both the rates and the pre-constants -- when estimating both the unknown tensor and the underlying tensor factors.
Comments: Accepted in part to ICML 2020
Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)
Journal reference: IEEE Transactions on Information Theory, vol. 69, no. 1, pp. 407-452, Jan. 2023
Cite as: arXiv:2006.08580 [stat.ML]
  (or arXiv:2006.08580v1 [stat.ML] for this version)

Submission history

From: Changxiao Cai [view email]
[v1] Mon, 15 Jun 2020 17:47:13 GMT (312kb)

Link back to: arXiv, form interface, contact.