We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Efficient parameter sampling for Markov jump processes

Abstract: Markov jump processes (MJPs) are continuous-time stochastic processes widely used in a variety of applied disciplines. Inference for MJPs typically proceeds via Markov chain Monte Carlo, the state-of-the-art being a uniformization-based auxiliary variable Gibbs sampler. This was designed for situations where the MJP parameters are known, and Bayesian inference over unknown parameters is typically carried out by incorporating it into a larger Gibbs sampler. This strategy of sampling parameters given path, and path given parameters can result in poor Markov chain mixing. In this work, we propose a simple and elegant algorithm to address this problem. Our scheme brings Metropolis-Hastings approaches for discrete-time hidden Markov models to the continuous-time setting, resulting in a complete and clean recipe for parameter and path inference in MJPs. In our experiments, we demonstrate superior performance over Gibbs sampling, as well as another popular approach, particle MCMC. We also show our sampler inherits geometric mixing from an `ideal' sampler that operates without computational constraints.
Comments: 42 pages, 17 Figures
Subjects: Computation (stat.CO)
Cite as: arXiv:1704.02369 [stat.CO]
  (or arXiv:1704.02369v3 [stat.CO] for this version)

Submission history

From: Boqian Zhang [view email]
[v1] Fri, 7 Apr 2017 20:42:21 GMT (1979kb,D)
[v2] Fri, 1 Jun 2018 00:43:25 GMT (595kb,D)
[v3] Sun, 12 Apr 2020 04:52:28 GMT (3860kb,D)

Link back to: arXiv, form interface, contact.