Current browse context:
cs.AI
Change to browse by:
References & Citations
Computer Science > Artificial Intelligence
Title: Measuring the non-asymptotic convergence of sequential Monte Carlo samplers using probabilistic programming
(Submitted on 7 Dec 2016 (v1), last revised 6 May 2017 (this version, v2))
Abstract: A key limitation of sampling algorithms for approximate inference is that it is difficult to quantify their approximation error. Widely used sampling schemes, such as sequential importance sampling with resampling and Metropolis-Hastings, produce output samples drawn from a distribution that may be far from the target posterior distribution. This paper shows how to upper-bound the symmetric KL divergence between the output distribution of a broad class of sequential Monte Carlo (SMC) samplers and their target posterior distributions, subject to assumptions about the accuracy of a separate gold-standard sampler. The proposed method applies to samplers that combine multiple particles, multinomial resampling, and rejuvenation kernels. The experiments show the technique being used to estimate bounds on the divergence of SMC samplers for posterior inference in a Bayesian linear regression model and a Dirichlet process mixture model.
Submission history
From: Marco Cusumano-Towner [view email][v1] Wed, 7 Dec 2016 09:29:58 GMT (121kb,D)
[v2] Sat, 6 May 2017 20:33:52 GMT (45kb,D)
Link back to: arXiv, form interface, contact.