References & Citations
Mathematics > Statistics Theory
Title: Convergence Rates of Two-Component MCMC Samplers
(Submitted on 26 Jun 2020 (v1), last revised 9 May 2021 (this version, v3))
Abstract: Component-wise MCMC algorithms, including Gibbs and conditional Metropolis-Hastings samplers, are commonly used for sampling from multivariate probability distributions. A long-standing question regarding Gibbs algorithms is whether a deterministic-scan (systematic-scan) sampler converges faster than its random-scan counterpart. We answer this question when the samplers involve two components by establishing an exact quantitative relationship between the $L^2$ convergence rates of the two samplers. The relationship shows that the deterministic-scan sampler converges faster. We also establish qualitative relations among the convergence rates of two-component Gibbs samplers and some conditional Metropolis-Hastings variants. For instance, it is shown that if some two-component conditional Metropolis-Hastings samplers are geometrically ergodic, then so are the associated Gibbs samplers.
Submission history
From: Qian Qin [view email][v1] Fri, 26 Jun 2020 05:12:30 GMT (68kb,D)
[v2] Fri, 22 Jan 2021 03:46:25 GMT (80kb,D)
[v3] Sun, 9 May 2021 02:48:11 GMT (77kb,D)
Link back to: arXiv, form interface, contact.