Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Regression Prior Networks
(Submitted on 20 Jun 2020 (v1), last revised 9 Dec 2020 (this version, v2))
Abstract: Prior Networks are a recently developed class of models which yield interpretable measures of uncertainty and have been shown to outperform state-of-the-art ensemble approaches on a range of tasks. They can also be used to distill an ensemble of models via Ensemble Distribution Distillation (EnD$^2$), such that its accuracy, calibration and uncertainty estimates are retained within a single model. However, Prior Networks have so far been developed only for classification tasks. This work extends Prior Networks and EnD$^2$ to regression tasks by considering the Normal-Wishart distribution. The properties of Regression Prior Networks are demonstrated on synthetic data, selected UCI datasets and a monocular depth estimation task, where they yield performance competitive with ensemble approaches.
Submission history
From: Andrey Malinin Dr. [view email][v1] Sat, 20 Jun 2020 14:50:14 GMT (9514kb,D)
[v2] Wed, 9 Dec 2020 09:34:21 GMT (31138kb,D)
Link back to: arXiv, form interface, contact.