We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Recursive Sampling for the Nyström Method

Abstract: We give the first algorithm for kernel Nystr\"om approximation that runs in *linear time in the number of training points* and is provably accurate for all kernel matrices, without dependence on regularity or incoherence conditions. The algorithm projects the kernel onto a set of $s$ landmark points sampled by their *ridge leverage scores*, requiring just $O(ns)$ kernel evaluations and $O(ns^2)$ additional runtime. While leverage score sampling has long been known to give strong theoretical guarantees for Nystr\"om approximation, by employing a fast recursive sampling scheme, our algorithm is the first to make the approach scalable. Empirically we show that it finds more accurate, lower rank kernel approximations in less time than popular techniques such as uniformly sampled Nystr\"om approximation and the random Fourier features method.
Comments: To appear, NIPS 2017
Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)
Cite as: arXiv:1605.07583 [cs.LG]
  (or arXiv:1605.07583v5 [cs.LG] for this version)

Submission history

From: Cameron Musco [view email]
[v1] Tue, 24 May 2016 18:56:57 GMT (31kb)
[v2] Tue, 31 May 2016 19:48:44 GMT (32kb)
[v3] Tue, 28 Feb 2017 16:37:17 GMT (1625kb)
[v4] Thu, 16 Mar 2017 17:58:14 GMT (1627kb)
[v5] Fri, 3 Nov 2017 14:40:15 GMT (1630kb)

Link back to: arXiv, form interface, contact.