We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Learning Proposals for Probabilistic Programs with Inference Combinators

Abstract: We develop operators for construction of proposals in probabilistic programs, which we refer to as inference combinators. Inference combinators define a grammar over importance samplers that compose primitive operations such as application of a transition kernel and importance resampling. Proposals in these samplers can be parameterized using neural networks, which in turn can be trained by optimizing variational objectives. The result is a framework for user-programmable variational methods that are correct by construction and can be tailored to specific models. We demonstrate the flexibility of this framework by implementing advanced variational methods based on amortized Gibbs sampling and annealing.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Programming Languages (cs.PL)
Cite as: arXiv:2103.00668 [stat.ML]
  (or arXiv:2103.00668v2 [stat.ML] for this version)

Submission history

From: Heiko Zimmermann [view email]
[v1] Mon, 1 Mar 2021 00:17:53 GMT (1627kb,D)
[v2] Wed, 3 Mar 2021 18:47:15 GMT (1627kb,D)

Link back to: arXiv, form interface, contact.