Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Projected BNNs: Avoiding weight-space pathologies by learning latent representations of neural network weights
(Submitted on 16 Nov 2018 (v1), revised 3 Dec 2018 (this version, v2), latest version 13 Jun 2019 (v3))
Abstract: While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing uncertainty over the parameters of these models (in a Bayesian setting) is challenging because of the high-dimensionality of the network parameter space and the correlations between these parameters. In this paper, we introduce a novel framework for variational inference for Bayesian neural networks that (1) encodes complex distributions in high-dimensional parameter space with representations in a low-dimensional latent space and (2) performs inference efficiently on the low-dimensional representations. Across a large array of synthetic and real-world datasets, we show that our method improves uncertainty characterization and model generalization when compared with methods that work directly in the parameter space.
Submission history
From: Melanie F. Pradier [view email][v1] Fri, 16 Nov 2018 19:51:43 GMT (1501kb,D)
[v2] Mon, 3 Dec 2018 04:19:46 GMT (1315kb,D)
[v3] Thu, 13 Jun 2019 02:18:59 GMT (6212kb,D)
Link back to: arXiv, form interface, contact.