We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Numerical Analysis

Title: Entropy minimizing distributions are worst-case optimal importance proposals

Authors: Frédéric Cérou (IRMAR, SIMSMART), Patrick Héas (IRMAR, SIMSMART), Mathias Rousset (SIMSMART, IRMAR)
Abstract: Importance sampling of target probability distributions belonging to a given convex class is considered. Motivated by previous results, the cost of importance sampling is quantified using the relative entropy of the target with respect to proposal distributions. Using a reference measure as a reference for cost, we prove under some general conditions that the worst-case optimal proposal is precisely given by the distribution minimizing entropy with respect to the reference within the considered convex class of distributions. The latter conditions are in particular satisfied when the convex class is defined using a push-forward map defining atomless conditional measures. Applications in which the optimal proposal is Gibbsian and can be practically sampled using Monte Carlo methods are discussed.
Subjects: Numerical Analysis (math.NA); Probability (math.PR); Computation (stat.CO)
Cite as: arXiv:2212.04292 [math.NA]
  (or arXiv:2212.04292v1 [math.NA] for this version)

Submission history

From: Mathias Rousset [view email]
[v1] Thu, 8 Dec 2022 14:35:26 GMT (24kb)

Link back to: arXiv, form interface, contact.