Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Kernel PCA with the Nyström method
(Submitted on 12 Sep 2021 (v1), last revised 18 Aug 2022 (this version, v3))
Abstract: The Nystr\"om method is one of the most popular techniques for improving the scalability of kernel methods. However, it has not yet been derived for kernel PCA in line with classical PCA. In this paper we derive kernel PCA with the Nystr\"om method, thereby providing one of the few available options to make kernel PCA scalable. We further study its statistical accuracy through a finite-sample confidence bound on the empirical reconstruction error compared to the full method. The behaviours of the method and bound are illustrated through computer experiments on multiple real-world datasets. As an application of the method we present kernel principal component regression with the Nystr\"om method, as an alternative to Nystr\"om kernel ridge regression for efficient regularized regression with kernels.
Submission history
From: Fredrik Hallgren [view email][v1] Sun, 12 Sep 2021 18:08:31 GMT (1597kb,D)
[v2] Sun, 17 Oct 2021 19:53:37 GMT (1598kb,D)
[v3] Thu, 18 Aug 2022 22:04:02 GMT (560kb,D)
Link back to: arXiv, form interface, contact.