We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Adaptive quadrature schemes for Bayesian inference via active learning

Abstract: Numerical integration and emulation are fundamental topics across scientific fields. We propose novel adaptive quadrature schemes based on an active learning procedure. We consider an interpolative approach for building a surrogate posterior density, combining it with Monte Carlo sampling methods and other quadrature rules. The nodes of the quadrature are sequentially chosen by maximizing a suitable acquisition function, which takes into account the current approximation of the posterior and the positions of the nodes. This maximization does not require additional evaluations of the true posterior. We introduce two specific schemes based on Gaussian and Nearest Neighbors (NN) bases. For the Gaussian case, we also provide a novel procedure for fitting the bandwidth parameter, in order to build a suitable emulator of a density function. With both techniques, we always obtain a positive estimation of the marginal likelihood (a.k.a., Bayesian evidence). An equivalent importance sampling interpretation is also described, which allows the design of extended schemes. Several theoretical results are provided and discussed. Numerical results show the advantage of the proposed approach, including a challenging inference problem in an astronomic dynamical model, with the goal of revealing the number of planets orbiting a star.
Comments: Keywords: Numerical integration; emulation; Monte Carlo methods; Bayesian quadrature; experimental design; active learning
Subjects: Computation (stat.CO); Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)
Journal reference: IEEE Access 8 (2020) 208462-208483
DOI: 10.1109/ACCESS.2020.3038333
Cite as: arXiv:2006.00535 [stat.CO]
  (or arXiv:2006.00535v3 [stat.CO] for this version)

Submission history

From: Fernando Llorente Fernández [view email]
[v1] Sun, 31 May 2020 15:02:32 GMT (793kb,D)
[v2] Wed, 3 Jun 2020 16:25:26 GMT (801kb,D)
[v3] Tue, 19 Jan 2021 16:44:59 GMT (1271kb,D)

Link back to: arXiv, form interface, contact.