Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Amortized Population Gibbs Samplers with Neural Sufficient Statistics
(Submitted on 4 Nov 2019 (v1), last revised 9 Jul 2020 (this version, v3))
Abstract: We develop amortized population Gibbs (APG) samplers, a class of scalable methods that frames structured variational inference as adaptive importance sampling. APG samplers construct high-dimensional proposals by iterating over updates to lower-dimensional blocks of variables. We train each conditional proposal by minimizing the inclusive KL divergence with respect to the conditional posterior. To appropriately account for the size of the input data, we develop a new parameterization in terms of neural sufficient statistics. Experiments show that APG samplers can train highly structured deep generative models in an unsupervised manner, and achieve substantial improvements in inference accuracy relative to standard autoencoding variational methods.
Submission history
From: Hao Wu [view email][v1] Mon, 4 Nov 2019 18:10:11 GMT (4891kb,D)
[v2] Thu, 26 Mar 2020 17:46:09 GMT (6331kb,D)
[v3] Thu, 9 Jul 2020 18:59:36 GMT (5183kb,D)
Link back to: arXiv, form interface, contact.