We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: On the Optimality of Nuclear-norm-based Matrix Completion for Problems with Smooth Non-linear Structure

Abstract: Originally developed for imputing missing entries in low rank, or approximately low rank matrices, matrix completion has proven widely effective in many problems where there is no reason to assume low-dimensional linear structure in the underlying matrix, as would be imposed by rank constraints. In this manuscript, we build some theoretical intuition for this behavior. We consider matrices which are not necessarily low-rank, but lie in a low-dimensional non-linear manifold. We show that nuclear-norm penalization is still effective for recovering these matrices when observations are missing completely at random. In particular, we give upper bounds on the rate of convergence as a function of the number of rows, columns, and observed entries in the matrix, as well as the smoothness and dimension of the non-linear embedding. We additionally give a minimax lower bound: This lower bound agrees with our upper bound (up to a logarithmic factor), which shows that nuclear-norm penalization is (up to log terms) minimax rate optimal for these problems.
Comments: 47 pages, 1 figure
Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2105.01874 [math.ST]
  (or arXiv:2105.01874v1 [math.ST] for this version)

Submission history

From: Yunhua Xiang [view email]
[v1] Wed, 5 May 2021 05:34:32 GMT (418kb,D)

Link back to: arXiv, form interface, contact.