Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Ensemble Kernel Methods, Implicit Regularization and Determinantal Point Processes
(Submitted on 24 Jun 2020 (v1), last revised 7 Jul 2020 (this version, v3))
Abstract: By using the framework of Determinantal Point Processes (DPPs), some theoretical results concerning the interplay between diversity and regularization can be obtained. In this paper we show that sampling subsets with kDPPs results in implicit regularization in the context of ridgeless Kernel Regression. Furthermore, we leverage the common setup of state-of-the-art DPP algorithms to sample multiple small subsets and use them in an ensemble of ridgeless regressions. Our first empirical results indicate that ensemble of ridgeless regressors can be interesting to use for datasets including redundant information.
Submission history
From: Joachim Schreurs [view email][v1] Wed, 24 Jun 2020 13:09:39 GMT (799kb)
[v2] Sat, 27 Jun 2020 11:52:33 GMT (799kb)
[v3] Tue, 7 Jul 2020 07:34:12 GMT (800kb)
Link back to: arXiv, form interface, contact.