We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: CRPS Learning

Abstract: Combination and aggregation techniques can significantly improve forecast accuracy. This also holds for probabilistic forecasting methods where predictive distributions are combined. There are several time-varying and adaptive weighting schemes such as Bayesian model averaging (BMA). However, the quality of different forecasts may vary not only over time but also within the distribution. For example, some distribution forecasts may be more accurate in the center of the distributions, while others are better at predicting the tails. Therefore, we introduce a new weighting method that considers the differences in performance over time and within the distribution. We discuss pointwise combination algorithms based on aggregation across quantiles that optimize with respect to the continuous ranked probability score (CRPS). After analyzing the theoretical properties of pointwise CRPS learning, we discuss B- and P-Spline-based estimation techniques for batch and online learning, based on quantile regression and prediction with expert advice. We prove that the proposed fully adaptive Bernstein online aggregation (BOA) method for pointwise CRPS online learning has optimal convergence properties. They are confirmed in simulations and a probabilistic forecasting study for European emission allowance (EUA) prices.
Comments: Accepted for publication in Journal of Econometrics
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM); Statistics Theory (math.ST); Statistical Finance (q-fin.ST)
DOI: 10.1016/j.jeconom.2021.11.008
Cite as: arXiv:2102.00968 [stat.ML]
  (or arXiv:2102.00968v3 [stat.ML] for this version)

Submission history

From: Jonathan Berrisch [view email]
[v1] Mon, 1 Feb 2021 16:54:05 GMT (2948kb,AD)
[v2] Thu, 5 Aug 2021 09:09:33 GMT (3117kb,AD)
[v3] Fri, 19 Nov 2021 10:10:28 GMT (3212kb,AD)

Link back to: arXiv, form interface, contact.