We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: ABC random forests for Bayesian parameter inference

Authors: Jean-Michel Marin (IMAG, Montpellier), Louis Raynal (IMAG, Montpellier), Pierre Pudlo (I2M, Marseille), Mathieu Ribatet (IMAG, Montpellier), Christian P. Robert (U. Paris-Dauphine and U. Warwick)
Abstract: Approximate Bayesian Computation (ABC) has grown into a standard methodology to handle Bayesian inference in models associated with intractable likelihood functions. Most ABC implementations require the selection of a summary statistic as the data itself is too large or too complex to be compared to simulated realisations from the assumed model. The dimension of this statistic is generally constrained to be close to the dimension of the model parameter for efficiency reasons. Furthermore, the tolerance level that governs the acceptance or rejection of parameter values needs to be calibrated and the range of calibration techniques available so far is mostly based on asymptotic arguments. We propose here to conduct Bayesian inference based on an arbitrarily large vector of summary statistics without imposing a selection of the relevant components and bypassing the derivation of a tolerance. The approach relies on the random forest methodology of Breiman (2001) when applied to regression. We advocate the derivation of a new random forest for each component of the parameter vector, a tool from which an approximation to the marginal posterior distribution can be derived. Correlations between parameter components are handled by separate random forests. This technology offers significant gains in terms of robustness to the choice of the summary statistics and of computing time, when compared with more standard ABC solutions.
Comments: 16 pages, 7 figures
Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:1605.05537 [stat.ME]
  (or arXiv:1605.05537v1 [stat.ME] for this version)

Submission history

From: Jean-Michel Marin [view email]
[v1] Wed, 18 May 2016 12:04:38 GMT (2154kb,D)
[v2] Tue, 28 Jun 2016 16:28:19 GMT (171kb,D)
[v3] Tue, 4 Jul 2017 14:36:45 GMT (158kb,D)
[v4] Tue, 14 Nov 2017 15:15:23 GMT (1911kb,D)
[v5] Fri, 2 Nov 2018 14:17:46 GMT (1929kb,D)

Link back to: arXiv, form interface, contact.