We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Ancillary-file links:

Ancillary files (details):

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Non-reversible jump algorithms for Bayesian nested model selection

Abstract: Non-reversible Markov chain Monte Carlo methods often outperform their reversible counterparts in terms of asymptotic variance of ergodic averages and mixing properties. Lifting the state-space (Chen et al., 1999; Diaconis et al., 2000) is a generic technique for constructing such samplers. The idea is to think of the random variables we want to generate as position variables and to associate to them direction variables so as to design Markov chains which do not have the diffusive behaviour often exhibited by reversible schemes. In this paper, we explore the benefits of using such ideas in the context of Bayesian model choice for nested models, a class of models for which the model indicator variable is an ordinal random variable. By lifting this model indicator variable, we obtain non-reversible jump algorithms, a non-reversible version of the popular reversible jump algorithms introduced by Green (1995). This simple algorithmic modification provides samplers which can empirically outperform their reversible counterparts at no extra computational cost. The code to reproduce all experiments is available online.
Comments: To appear in Journal of Computational and Graphical Statistics
Subjects: Computation (stat.CO); Methodology (stat.ME)
Cite as: arXiv:1911.01340 [stat.CO]
  (or arXiv:1911.01340v3 [stat.CO] for this version)

Submission history

From: Philippe Gagnon [view email]
[v1] Mon, 4 Nov 2019 17:05:18 GMT (413kb,AD)
[v2] Fri, 8 May 2020 16:44:23 GMT (95kb,AD)
[v3] Sun, 20 Dec 2020 01:26:00 GMT (95kb,AD)

Link back to: arXiv, form interface, contact.