Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Minimally Faithful Inversion of Graphical Models
(Submitted on 1 Dec 2017 (v1), revised 10 Feb 2018 (this version, v2), latest version 29 Nov 2018 (v5))
Abstract: Inference amortization methods allow the sharing of statistical strength across related observations when learning to perform posterior inference. Generally this requires the inversion of the dependency structure in the generative model, as the modeller must design and learn a distribution to approximate the posterior. Previous methods invert the dependency structure in a heuristic way and fail to capture the dependencies in the model, therefore limiting the performance of the eventual inference algorithm. We introduce an algorithm for faithfully and minimally inverting the graphical model structure of any generative model. Such an inversion has two crucial properties: a) it does not encode any independence assertions absent from the model, and b) for a given inversion, it encodes as many true independence assertions as possible. Our algorithm works by simulating variable elimination on the generative model to reparametrize the distribution. We show with experiments how such minimal inversions can assist in performing better inference.
Submission history
From: Stefan Webb [view email][v1] Fri, 1 Dec 2017 12:08:03 GMT (5554kb,D)
[v2] Sat, 10 Feb 2018 18:16:17 GMT (8849kb,D)
[v3] Tue, 29 May 2018 15:47:44 GMT (8244kb,D)
[v4] Wed, 24 Oct 2018 15:58:18 GMT (9104kb,D)
[v5] Thu, 29 Nov 2018 14:27:47 GMT (9087kb,D)
Link back to: arXiv, form interface, contact.