Current browse context:
stat.CO
Change to browse by:
References & Citations
Statistics > Computation
Title: Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance
(Submitted on 29 Jun 2017 (v1), last revised 24 Mar 2020 (this version, v6))
Abstract: We establish an ordering criterion for the asymptotic variances of two consistent Markov chain Monte Carlo (MCMC) estimators: an importance sampling (IS) estimator, based on an approximate reversible chain and subsequent IS weighting, and a standard MCMC estimator, based on an exact reversible chain. Essentially, we relax the criterion of the Peskun type covariance ordering by considering two different invariant probabilities, and obtain, in place of a strict ordering of asymptotic variances, a bound of the asymptotic variance of IS by that of the direct MCMC. Simple examples show that IS can have arbitrarily better or worse asymptotic variance than Metropolis-Hastings and delayed-acceptance (DA) MCMC. Our ordering implies that IS is guaranteed to be competitive up to a factor depending on the supremum of the (marginal) IS weight. We elaborate upon the criterion in case of unbiased estimators as part of an auxiliary variable framework. We show how the criterion implies asymptotic variance guarantees for IS in terms of pseudo-marginal (PM) and DA corrections, essentially if the ratio of exact and approximate likelihoods is bounded. We also show that convergence of the IS chain can be less affected by unbounded high-variance unbiased estimators than PM and DA chains.
Submission history
From: Jordan Franks [view email][v1] Thu, 29 Jun 2017 17:37:23 GMT (42kb,D)
[v2] Fri, 23 Mar 2018 17:42:31 GMT (42kb,D)
[v3] Thu, 26 Apr 2018 16:57:22 GMT (48kb,D)
[v4] Mon, 4 Mar 2019 12:01:56 GMT (51kb,D)
[v5] Mon, 1 Jul 2019 10:38:37 GMT (51kb,D)
[v6] Tue, 24 Mar 2020 16:07:03 GMT (49kb,D)
Link back to: arXiv, form interface, contact.