We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Scalable Control Variates for Monte Carlo Methods via Stochastic Optimization

Abstract: Control variates are a well-established tool to reduce the variance of Monte Carlo estimators. However, for large-scale problems including high-dimensional and large-sample settings, their advantages can be outweighed by a substantial computational cost. This paper considers control variates based on Stein operators, presenting a framework that encompasses and generalizes existing approaches that use polynomials, kernels and neural networks. A learning strategy based on minimising a variational objective through stochastic optimization is proposed, leading to scalable and effective control variates. Novel theoretical results are presented to provide insight into the variance reduction that can be achieved, and an empirical assessment, including applications to Bayesian inference, is provided in support.
Comments: Accepted by MCQMC2020
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
MSC classes: G.3
Cite as: arXiv:2006.07487 [stat.ML]
  (or arXiv:2006.07487v2 [stat.ML] for this version)

Submission history

From: Shijing Si [view email]
[v1] Fri, 12 Jun 2020 22:03:25 GMT (775kb,D)
[v2] Wed, 21 Jul 2021 11:46:11 GMT (1686kb,D)

Link back to: arXiv, form interface, contact.