Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Novel Change of Measure Inequalities with Applications to PAC-Bayesian Bounds and Monte Carlo Estimation
(Submitted on 25 Feb 2020 (v1), last revised 25 Jun 2020 (this version, v2))
Abstract: We introduce several novel change of measure inequalities for two families of divergences: $f$-divergences and $\alpha$-divergences. We show how the variational representation for $f$-divergences leads to novel change of measure inequalities. We also present a multiplicative change of measure inequality for $\alpha$-divergences and a generalized version of Hammersley-Chapman-Robbins inequality. Finally, we present several applications of our change of measure inequalities, including PAC-Bayesian bounds for various classes of losses and non-asymptotic intervals for Monte Carlo estimates.
Submission history
From: Yuki Ohnishi [view email][v1] Tue, 25 Feb 2020 05:36:22 GMT (15kb)
[v2] Thu, 25 Jun 2020 10:11:04 GMT (24kb)
Link back to: arXiv, form interface, contact.