Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: AutoCP: Automated Pipelines for Accurate Prediction Intervals
(Submitted on 24 Jun 2020 (v1), last revised 13 Sep 2020 (this version, v2))
Abstract: Successful application of machine learning models to real-world prediction problems, e.g. financial forecasting and personalized medicine, has proved to be challenging, because such settings require limiting and quantifying the uncertainty in the model predictions, i.e. providing valid and accurate prediction intervals. Conformal Prediction is a distribution-free approach to construct valid prediction intervals in finite samples. However, the prediction intervals constructed by Conformal Prediction are often (because of over-fitting, inappropriate measures of nonconformity, or other issues) overly conservative and hence inadequate for the application(s) at hand. This paper proposes an AutoML framework called Automatic Machine Learning for Conformal Prediction (AutoCP). Unlike the familiar AutoML frameworks that attempt to select the best prediction model, AutoCP constructs prediction intervals that achieve the user-specified target coverage rate while optimizing the interval length to be accurate and less conservative. We tested AutoCP on a variety of datasets and found that it significantly outperforms benchmark algorithms.
Submission history
From: Yao Zhang [view email][v1] Wed, 24 Jun 2020 23:13:11 GMT (912kb,D)
[v2] Sun, 13 Sep 2020 15:29:34 GMT (423kb,D)
Link back to: arXiv, form interface, contact.