We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Multivariate Probabilistic Regression with Natural Gradient Boosting

Abstract: Many single-target regression problems require estimates of uncertainty along with the point predictions. Probabilistic regression algorithms are well-suited for these tasks. However, the options are much more limited when the prediction target is multivariate and a joint measure of uncertainty is required. For example, in predicting a 2D velocity vector a joint uncertainty would quantify the probability of any vector in the plane, which would be more expressive than two separate uncertainties on the x- and y- components. To enable joint probabilistic regression, we propose a Natural Gradient Boosting (NGBoost) approach based on nonparametrically modeling the conditional parameters of the multivariate predictive distribution. Our method is robust, works out-of-the-box without extensive tuning, is modular with respect to the assumed target distribution, and performs competitively in comparison to existing approaches. We demonstrate these claims in simulation and with a case study predicting two-dimensional oceanographic velocity data. An implementation of our method is available at this https URL
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)
Cite as: arXiv:2106.03823 [stat.ML]
  (or arXiv:2106.03823v1 [stat.ML] for this version)

Submission history

From: Michael O'Malley [view email]
[v1] Mon, 7 Jun 2021 17:44:49 GMT (811kb,D)

Link back to: arXiv, form interface, contact.