Current browse context:
cs.NA
Change to browse by:
References & Citations
Computer Science > Numerical Analysis
Title: Scalable Robust Matrix Factorization with Nonconvex Loss
(Submitted on 19 Oct 2017 (v1), last revised 23 Sep 2018 (this version, v4))
Abstract: Robust matrix factorization (RMF), which uses the $\ell_1$-loss, often outperforms standard matrix factorization using the $\ell_2$-loss, particularly when outliers are present. The state-of-the-art RMF solver is the RMF-MM algorithm, which, however, cannot utilize data sparsity. Moreover, sometimes even the (convex) $\ell_1$-loss is not robust enough. In this paper, we propose the use of nonconvex loss to enhance robustness. To address the resultant difficult optimization problem, we use majorization-minimization (MM) optimization and propose a new MM surrogate. To improve scalability, we exploit data sparsity and optimize the surrogate via its dual with the accelerated proximal gradient algorithm. The resultant algorithm has low time and space complexities and is guaranteed to converge to a critical point. Extensive experiments demonstrate its superiority over the state-of-the-art in terms of both accuracy and scalability.
Submission history
From: Quanming Yao [view email][v1] Thu, 19 Oct 2017 15:55:27 GMT (283kb)
[v2] Sat, 10 Feb 2018 07:19:26 GMT (753kb,D)
[v3] Sat, 19 May 2018 02:38:13 GMT (1061kb,D)
[v4] Sun, 23 Sep 2018 15:08:23 GMT (866kb,D)
Link back to: arXiv, form interface, contact.