We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Parallel Markov Chain Monte Carlo via Spectral Clustering

Abstract: As it has become common to use many computer cores in routine applications, finding good ways to parallelize popular algorithms has become increasingly important. In this paper, we present a parallelization scheme for Markov chain Monte Carlo (MCMC) methods based on spectral clustering of the underlying state space, generalizing earlier work on parallelization of MCMC methods by state space partitioning. We show empirically that this approach speeds up MCMC sampling for multimodal distributions and that it can be usefully applied in greater generality than several related algorithms. Our algorithm converges under reasonable conditions to an `optimal' MCMC algorithm. We also show that our approach can be asymptotically far more efficient than naive parallelization, even in situations such as completely flat target distributions where no unique optimal algorithm exists. Finally, we combine theoretical and empirical bounds to provide practical guidance on the choice of tuning parameters.
Comments: Appeared in Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS) 2016
Subjects: Methodology (stat.ME); Computation (stat.CO)
Cite as: arXiv:1605.09454 [stat.ME]
  (or arXiv:1605.09454v1 [stat.ME] for this version)

Submission history

From: Guillaume Basse [view email]
[v1] Tue, 31 May 2016 00:40:09 GMT (91kb,D)

Link back to: arXiv, form interface, contact.