We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Normalizing Constant Estimation with Gaussianized Bridge Sampling

Abstract: Normalizing constant (also called partition function, Bayesian evidence, or marginal likelihood) is one of the central goals of Bayesian inference, yet most of the existing methods are both expensive and inaccurate. Here we develop a new approach, starting from posterior samples obtained with a standard Markov Chain Monte Carlo (MCMC). We apply a novel Normalizing Flow (NF) approach to obtain an analytic density estimator from these samples, followed by Optimal Bridge Sampling (OBS) to obtain the normalizing constant. We compare our method which we call Gaussianized Bridge Sampling (GBS) to existing methods such as Nested Sampling (NS) and Annealed Importance Sampling (AIS) on several examples, showing our method is both significantly faster and substantially more accurate than these methods, and comes with a reliable error estimation.
Comments: Accepted by AABI 2019 Proceedings
Subjects: Machine Learning (stat.ML); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)
Journal reference: Proceedings of The 2nd Symposium on Advances in Approximate Bayesian Inference, PMLR 118:1-14, 2020
Cite as: arXiv:1912.06073 [stat.ML]
  (or arXiv:1912.06073v1 [stat.ML] for this version)

Submission history

From: He Jia [view email]
[v1] Thu, 12 Dec 2019 16:50:03 GMT (800kb,D)

Link back to: arXiv, form interface, contact.