We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Posterior-based proposals for speeding up Markov chain Monte Carlo

Abstract: Markov chain Monte Carlo (MCMC) is widely used for Bayesian inference in models of complex systems. Performance, however, is often unsatisfactory in models with many latent variables due to so-called poor mixing, necessitating development of application specific implementations. This paper introduces "posterior-based proposals" (PBPs), a new type of MCMC update applicable to a huge class of statistical models (whose conditional dependence structures are represented by directed acyclic graphs). PBPs generates large joint updates in parameter and latent variable space, whilst retaining good acceptance rates (typically 33%). Evaluation against other approaches (from standard Gibbs / random walk updates to state-of-the-art Hamiltonian and particle MCMC methods) was carried out for widely varying model types: an individual-based model for disease diagnostic test data, a financial stochastic volatility model, a mixed model used in statistical genetics and a population model used in ecology. Whilst different methods worked better or worse in different scenarios, PBPs were found to be either near to the fastest or significantly faster than the next best approach (by up to a factor of 10). PBPs therefore represent an additional general purpose technique that can be usefully applied in a wide variety of contexts.
Comments: 54 pages, 11 figures, 2 tables
Subjects: Methodology (stat.ME); Applications (stat.AP); Computation (stat.CO)
Cite as: arXiv:1903.10221 [stat.ME]
  (or arXiv:1903.10221v2 [stat.ME] for this version)

Submission history

From: Christopher Pooley Dr [view email]
[v1] Mon, 25 Mar 2019 10:16:08 GMT (3284kb)
[v2] Thu, 24 Oct 2019 16:07:20 GMT (4416kb)

Link back to: arXiv, form interface, contact.