Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: PAC$^m$-Bayes: Narrowing the Empirical Risk Gap in the Misspecified Bayesian Regime
(Submitted on 19 Oct 2020 (v1), last revised 23 May 2022 (this version, v3))
Abstract: The Bayesian posterior minimizes the "inferential risk" which itself bounds the "predictive risk". This bound is tight when the likelihood and prior are well-specified. However since misspecification induces a gap, the Bayesian posterior predictive distribution may have poor generalization performance. This work develops a multi-sample loss (PAC$^m$) which can close the gap by spanning a trade-off between the two risks. The loss is computationally favorable and offers PAC generalization guarantees. Empirical study demonstrates improvement to the predictive distribution.
Submission history
From: Alexander Alemi [view email][v1] Mon, 19 Oct 2020 16:08:34 GMT (2666kb,D)
[v2] Mon, 8 Feb 2021 21:10:18 GMT (2761kb,D)
[v3] Mon, 23 May 2022 17:05:06 GMT (2216kb,D)
Link back to: arXiv, form interface, contact.