We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Gen-Oja: A Two-time-scale approach for Streaming CCA

Abstract: In this paper, we study the problems of principal Generalized Eigenvector computation and Canonical Correlation Analysis in the stochastic setting. We propose a simple and efficient algorithm, Gen-Oja, for these problems. We prove the global convergence of our algorithm, borrowing ideas from the theory of fast-mixing Markov chains and two-time-scale stochastic approximation, showing that it achieves the optimal rate of convergence. In the process, we develop tools for understanding stochastic processes with Markovian noise which might be of independent interest.
Comments: Accepted at NeurIPS 2018
Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)
Cite as: arXiv:1811.08393 [cs.LG]
  (or arXiv:1811.08393v2 [cs.LG] for this version)

Submission history

From: Kush Bhatia [view email]
[v1] Tue, 20 Nov 2018 17:57:13 GMT (83kb)
[v2] Sat, 1 Feb 2020 01:19:06 GMT (162kb)

Link back to: arXiv, form interface, contact.