Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Parallelizing Spectral Algorithms for Kernel Learning
(Submitted on 24 Oct 2016 (v1), last revised 9 Aug 2017 (this version, v4))
Abstract: We consider a distributed learning approach in supervised learning for a large class of spectral regularization methods in an RKHS framework. The data set of size n is partitioned into $m=O(n^\alpha)$ disjoint subsets. On each subset, some spectral regularization method (belonging to a large class, including in particular Kernel Ridge Regression, $L^2$-boosting and spectral cut-off) is applied. The regression function $f$ is then estimated via simple averaging, leading to a substantial reduction in computation time. We show that minimax optimal rates of convergence are preserved if m grows sufficiently slowly (corresponding to an upper bound for $\alpha$) as $n \to \infty$, depending on the smoothness assumptions on $f$ and the intrinsic dimensionality. In spirit, our approach is classical.
Submission history
From: Nicole Mücke [view email][v1] Mon, 24 Oct 2016 16:50:43 GMT (24kb)
[v2] Sun, 13 Nov 2016 08:07:03 GMT (24kb)
[v3] Sun, 22 Jan 2017 21:13:22 GMT (25kb)
[v4] Wed, 9 Aug 2017 11:30:39 GMT (414kb,D)
Link back to: arXiv, form interface, contact.