We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Aleatoric uncertainty for Errors-in-Variables models in deep regression

Abstract: A Bayesian treatment of deep learning allows for the computation of uncertainties associated with the predictions of deep neural networks. We show how the concept of Errors-in-Variables can be used in Bayesian deep regression to also account for the uncertainty associated with the input of the employed neural network. The presented approach thereby exploits a relevant, but generally overlooked, source of uncertainty and yields a decomposition of the predictive uncertainty into an aleatoric and epistemic part that is more complete and, in many cases, more consistent from a statistical perspective. We discuss the approach along various simulated and real examples and observe that using an Errors-in-Variables model leads to an increase in the uncertainty while preserving the prediction performance of models without Errors-in-Variables. For examples with known regression function we observe that this ground truth is substantially better covered by the Errors-in-Variables model, indicating that the presented approach leads to a more reliable uncertainty estimation.
Comments: 9 pages
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)
ACM classes: I.5.1; I.2.m; G.3
Journal reference: Neural Processing Letters (2022): 1-20
DOI: 10.1007/s11063-022-11066-3
Cite as: arXiv:2105.09095 [cs.LG]
  (or arXiv:2105.09095v3 [cs.LG] for this version)

Submission history

From: Jörg Martin [view email]
[v1] Wed, 19 May 2021 12:37:02 GMT (1538kb,D)
[v2] Thu, 27 May 2021 08:51:07 GMT (1111kb,D)
[v3] Fri, 12 May 2023 11:25:49 GMT (700kb,D)

Link back to: arXiv, form interface, contact.