We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Bayesian Additive Regression Trees with Model Trees

Abstract: Bayesian Additive Regression Trees (BART) is a tree-based machine learning method that has been successfully applied to regression and classification problems. BART assumes regularisation priors on a set of trees that work as weak learners and is very flexible for predicting in the presence of non-linearity and high-order interactions. In this paper, we introduce an extension of BART, called Model Trees BART (MOTR-BART), that considers piecewise linear functions at node levels instead of piecewise constants. In MOTR-BART, rather than having a unique value at node level for the prediction, a linear predictor is estimated considering the covariates that have been used as the split variables in the corresponding tree. In our approach, local linearities are captured more efficiently and fewer trees are required to achieve equal or better performance than BART. Via simulation studies and real data applications, we compare MOTR-BART to its main competitors. R code for MOTR-BART implementation is available at this https URL
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Journal reference: Statistics and Computing 31, 20 (2021)
DOI: 10.1007/s11222-021-09997-3
Cite as: arXiv:2006.07493 [stat.ML]
  (or arXiv:2006.07493v5 [stat.ML] for this version)

Submission history

From: Estevão Batista Do Prado [view email]
[v1] Fri, 12 Jun 2020 22:19:58 GMT (63kb,D)
[v2] Wed, 7 Oct 2020 10:23:36 GMT (577kb,D)
[v3] Wed, 18 Nov 2020 18:10:16 GMT (578kb,D)
[v4] Thu, 31 Dec 2020 00:59:41 GMT (264kb,D)
[v5] Wed, 10 Mar 2021 16:20:03 GMT (293kb,D)

Link back to: arXiv, form interface, contact.