We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Learning Parameters for Weighted Matrix Completion via Empirical Estimation

Authors: Jason Jo
Abstract: Recently theoretical guarantees have been obtained for matrix completion in the non-uniform sampling regime. In particular, if the sampling distribution aligns with the underlying matrix's leverage scores, then with high probability nuclear norm minimization will exactly recover the low rank matrix. In this article, we analyze the scenario in which the non-uniform sampling distribution may or may not not align with the underlying matrix's leverage scores. Here we explore learning the parameters for weighted nuclear norm minimization in terms of the empirical sampling distribution. We provide a sufficiency condition for these learned weights which provide an exact recovery guarantee for weighted nuclear norm minimization. It has been established that a specific choice of weights in terms of the true sampling distribution not only allows for weighted nuclear norm minimization to exactly recover the low rank matrix, but also allows for a quantifiable relaxation in the exact recovery conditions. In this article we extend this quantifiable relaxation in exact recovery conditions for a specific choice of weights defined analogously in terms of the empirical distribution as opposed to the true sampling distribution. To accomplish this we employ a concentration of measure bound and a large deviation bound. We also present numerical evidence for the healthy robustness of the weighted nuclear norm minimization algorithm to the choice of empirically learned weights. These numerical experiments show that for a variety of easily computable empirical weights, weighted nuclear norm minimization outperforms unweighted nuclear norm minimization in the non-uniform sampling regime.
Comments: Simplified the analysis
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1501.00192 [stat.ML]
  (or arXiv:1501.00192v4 [stat.ML] for this version)

Submission history

From: Jason Jo [view email]
[v1] Wed, 31 Dec 2014 19:10:52 GMT (34kb,D)
[v2] Wed, 7 Jan 2015 19:56:41 GMT (35kb,D)
[v3] Tue, 20 Jan 2015 01:22:29 GMT (35kb,D)
[v4] Thu, 2 Apr 2015 02:52:12 GMT (32kb,D)

Link back to: arXiv, form interface, contact.