References & Citations
Statistics > Other Statistics
Title: High-dimensional nonparametric monotone function estimation using BART
(Submitted on 6 Dec 2016 (v1), revised 18 Aug 2019 (this version, v2), latest version 8 Oct 2021 (v3))
Abstract: For the estimation of a regression relationship between Y and a large set of potential predictors x 1 , . . . , x p , the flexible nature of a nonparametric approach such as BART (Bayesian Additive Regression Trees) allows for a much richer set of possibilities than a more restrictive parametric approach. However, it may often occur that subject matter considerations suggest the relationship will be monotone in one or more of the predictors. For such situations, we propose monotone BART, a constrained version of BART that uses the monotonicity information to improve function estimation without the need of using a parametric form. Imposing monotonicity, when appropriate, results in (i) function estimates that are smoother and more interpretable, (ii) better out-of-sample predictive performance, (iii) less uncertainty, and (iv) less sensitivity to prior choice. While some of the key aspects of the unconstrained BART model carry over directly to monotone BART, the imposition of the monotonicity constraints necessitates a fundamental rethinking of how the model is implemented. In particular, in the original BART algorithm, the Markov Chain Monte Carlo algorithm relied on a conditional conjugacy that is no longer available in a high-dimensional, constrained space.
Submission history
From: Robert McCulloch [view email][v1] Tue, 6 Dec 2016 01:24:34 GMT (587kb,D)
[v2] Sun, 18 Aug 2019 15:03:18 GMT (3142kb,D)
[v3] Fri, 8 Oct 2021 13:18:55 GMT (3362kb,D)
Link back to: arXiv, form interface, contact.