Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Differentiable Model Selection for Ensemble Learning
(Submitted on 1 Nov 2022 (v1), last revised 19 May 2023 (this version, v2))
Abstract: Model selection is a strategy aimed at creating accurate and robust models. A key challenge in designing these algorithms is identifying the optimal model for classifying any particular input sample. This paper addresses this challenge and proposes a novel framework for differentiable model selection integrating machine learning and combinatorial optimization. The framework is tailored for ensemble learning, a strategy that combines the outputs of individually pre-trained models, and learns to select appropriate ensemble members for a particular input sample by transforming the ensemble learning task into a differentiable selection program trained end-to-end within the ensemble learning model. Tested on various tasks, the proposed framework demonstrates its versatility and effectiveness, outperforming conventional and advanced consensus rules across a variety of settings and learning tasks.
Submission history
From: Ferdinando Fioretto [view email][v1] Tue, 1 Nov 2022 03:37:49 GMT (694kb,D)
[v2] Fri, 19 May 2023 16:59:33 GMT (5820kb,D)
Link back to: arXiv, form interface, contact.