Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: A Kernel-based Consensual Regression Aggregation Method
(Submitted on 1 Jul 2020 (v1), revised 2 Mar 2021 (this version, v3), latest version 28 Apr 2021 (v4))
Abstract: In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators $r_1,r_2,...,r_M$ using a weighted average where the weights are defined based on some kernel function. It may be seen as a kernel smoother method implemented on the features of predictions, given by all the individual estimators, instead of the original inputs. This work extends the context of Biau et al. (2016) to a more general kernel-based framework. We show that this configuration asymptotically inherits the consistency property of the basic consistent estimators. Moreover, we propose to numerically learn the key parameter of the method using a gradient descent algorithm for a suitable choice of kernel functions instead of using the classical grid search algorithm. The numerical experiments carried out on several simulated and real datasets suggest that the performance of the method is improved with the introduction of kernel functions.
Submission history
From: Sothea Has [view email][v1] Wed, 1 Jul 2020 07:43:30 GMT (16kb)
[v2] Fri, 26 Feb 2021 07:59:44 GMT (30kb)
[v3] Tue, 2 Mar 2021 08:54:23 GMT (30kb)
[v4] Wed, 28 Apr 2021 09:02:45 GMT (55kb,D)
Link back to: arXiv, form interface, contact.