We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Ancillary-file links:

Ancillary files (details):

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Optimal scaling of random-walk Metropolis algorithms using Bayesian large-sample asymptotics

Abstract: High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the target density is typically assumed to be of a product form. Users may thus doubt the validity of such tuning rules in practical applications. In this paper, we shed some light on optimal-scaling problems from a different perspective, namely a large-sample one. This allows to prove weak convergence results under realistic assumptions and to propose novel parameter-dimension-dependent tuning guidelines. The proposed guidelines are consistent with previous ones when the target density is close to having a product form, and the results highlight that the correlation structure has to be accounted for to avoid performance deterioration if that is not the case, while justifying the use of a natural (asymptotically exact) approximation to the correlation matrix that can be employed for the very first algorithm run.
Comments: Both authors contributed equally. The paper is to appear in Statistics and Computing
Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:2104.06384 [stat.ME]
  (or arXiv:2104.06384v3 [stat.ME] for this version)

Submission history

From: Philippe Gagnon [view email]
[v1] Tue, 13 Apr 2021 17:39:50 GMT (120kb,AD)
[v2] Tue, 27 Apr 2021 23:27:22 GMT (122kb,AD)
[v3] Tue, 15 Feb 2022 00:34:34 GMT (116kb,AD)

Link back to: arXiv, form interface, contact.