Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Projected BNNs: Avoiding weight-space pathologies by learning latent representations of neural network weights
(Submitted on 16 Nov 2018 (v1), last revised 13 Jun 2019 (this version, v3))
Abstract: As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing uncertainty over the parameters of these models is challenging because of the high dimensionality and complex correlations of the network parameter space. This paper introduces a novel variational inference framework for Bayesian neural networks that (1) encodes complex distributions in high-dimensional parameter space with representations in a low-dimensional latent space, and (2) performs inference efficiently on the low-dimensional representations. Across a large array of synthetic and real-world datasets, we show that our method improves uncertainty characterization and model generalization when compared with methods that work directly in the parameter space.
Submission history
From: Melanie F. Pradier [view email][v1] Fri, 16 Nov 2018 19:51:43 GMT (1501kb,D)
[v2] Mon, 3 Dec 2018 04:19:46 GMT (1315kb,D)
[v3] Thu, 13 Jun 2019 02:18:59 GMT (6212kb,D)
Link back to: arXiv, form interface, contact.