Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Latent Gaussian Model Boosting
(Submitted on 19 May 2021 (v1), last revised 25 Jul 2022 (this version, v6))
Abstract: Latent Gaussian models and boosting are widely used techniques in statistics and machine learning. Tree-boosting shows excellent prediction accuracy on many data sets, but potential drawbacks are that it assumes conditional independence of samples, produces discontinuous predictions for, e.g., spatial data, and it can have difficulty with high-cardinality categorical variables. Latent Gaussian models, such as Gaussian process and grouped random effects models, are flexible prior models which explicitly model dependence among samples and which allow for efficient learning of predictor functions and for making probabilistic predictions. However, existing latent Gaussian models usually assume either a zero or a linear prior mean function which can be an unrealistic assumption. This article introduces a novel approach that combines boosting and latent Gaussian models to remedy the above-mentioned drawbacks and to leverage the advantages of both techniques. We obtain increased prediction accuracy compared to existing approaches in both simulated and real-world data experiments.
Submission history
From: Fabio Sigrist [view email][v1] Wed, 19 May 2021 07:36:30 GMT (358kb,D)
[v2] Fri, 21 May 2021 13:42:12 GMT (358kb,D)
[v3] Mon, 3 Jan 2022 15:18:08 GMT (405kb,D)
[v4] Thu, 14 Apr 2022 19:54:53 GMT (403kb,D)
[v5] Fri, 1 Jul 2022 12:04:40 GMT (399kb,D)
[v6] Mon, 25 Jul 2022 15:43:55 GMT (403kb,D)
Link back to: arXiv, form interface, contact.