Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Matrix Completion has No Spurious Local Minimum
(Submitted on 24 May 2016 (this version), latest version 22 Jul 2018 (v4))
Abstract: Matrix completion is a basic machine learning problem that has wide applications, especially in collaborative filtering and recommender systems. Simple non-convex optimization algorithms are popular and effective in practice. Despite recent progress in proving various non-convex algorithms converge from a good initial point, it remains unclear why random or arbitrary initialization suffices in practice. We prove that the commonly used non-convex objective function for matrix completion has no spurious local minima -- all local minima must also be global. Therefore, many popular optimization algorithms such as (stochastic) gradient descent can provably solve matrix completion with \textit{arbitrary} initialization in polynomial time.
Submission history
From: Tengyu Ma [view email][v1] Tue, 24 May 2016 02:53:27 GMT (440kb,D)
[v2] Fri, 16 Sep 2016 19:58:48 GMT (451kb,D)
[v3] Sun, 29 Jan 2017 18:45:48 GMT (457kb,D)
[v4] Sun, 22 Jul 2018 05:20:12 GMT (127kb,D)
Link back to: arXiv, form interface, contact.