We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Being a Bit Frequentist Improves Bayesian Neural Networks

Abstract: Despite their compelling theoretical properties, Bayesian neural networks (BNNs) tend to perform worse than frequentist methods in classification-based uncertainty quantification (UQ) tasks such as out-of-distribution (OOD) detection. In this paper, based on empirical findings in prior works, we hypothesize that this issue is because even recent Bayesian methods have never considered OOD data in their training processes, even though this "OOD training" technique is an integral part of state-of-the-art frequentist UQ methods. To validate this, we treat OOD data as a first-class citizen in BNN training by exploring four different ways of incorporating OOD data into Bayesian inference. We show in extensive experiments that OOD-trained BNNs are competitive to recent frequentist baselines. This work thus provides strong baselines for future work in Bayesian UQ.
Comments: AISTATS 2022
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2106.10065 [cs.LG]
  (or arXiv:2106.10065v3 [cs.LG] for this version)

Submission history

From: Agustinus Kristiadi [view email]
[v1] Fri, 18 Jun 2021 11:22:42 GMT (1134kb,D)
[v2] Mon, 18 Oct 2021 15:25:40 GMT (1230kb,D)
[v3] Wed, 2 Feb 2022 15:27:28 GMT (1089kb,D)

Link back to: arXiv, form interface, contact.