Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Online Multiview Representation Learning: Dropping Convexity for Better Efficiency
(Submitted on 27 Feb 2017 (v1), revised 2 Mar 2017 (this version, v2), latest version 16 Sep 2019 (v10))
Abstract: Multiview representation learning is very popular for latent factor analysis. It naturally arises in many data analysis, machine learning, and information retrieval applications to model dependent structures between a pair of data matrices. For computational convenience, existing approaches usually formulate the multiview representation learning as convex optimization problems, where global optima can be obtained by certain algorithms in polynomial time. However, many evidences have corroborated that heuristic nonconvex approaches also have good empirical computational performance and convergence to the global optima, although there is a lack of theoretical justification. Such a gap between theory and practice motivates us to study a nonconvex formulation for multiview representation learning, which can be efficiently solved by two stochastic gradient descent (SGD) methods. Theoretically, by analyzing the dynamics of the algorithms based on diffusion processes, we establish global rates of convergence to the global optima with high probability. Numerical experiments are provided to support our theory.
Submission history
From: Zhehui Chen [view email][v1] Mon, 27 Feb 2017 03:51:46 GMT (1777kb,D)
[v2] Thu, 2 Mar 2017 18:50:40 GMT (3368kb,D)
[v3] Fri, 24 Mar 2017 00:21:18 GMT (5324kb,D)
[v4] Mon, 5 Jun 2017 22:20:23 GMT (5271kb,D)
[v5] Sat, 22 Jul 2017 17:58:40 GMT (1779kb,D)
[v6] Sat, 14 Oct 2017 19:19:19 GMT (2418kb,D)
[v7] Wed, 23 May 2018 13:47:47 GMT (1782kb,D)
[v8] Thu, 31 May 2018 18:41:42 GMT (1782kb,D)
[v9] Sun, 6 Jan 2019 15:46:41 GMT (2193kb,D)
[v10] Mon, 16 Sep 2019 01:00:53 GMT (2177kb,D)
Link back to: arXiv, form interface, contact.