We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Scalable Semi-Modular Inference with Variational Meta-Posteriors

Abstract: The Cut posterior and related Semi-Modular Inference are Generalised Bayes methods for Modular Bayesian evidence combination. Analysis is broken up over modular sub-models of the joint posterior distribution. Model-misspecification in multi-modular models can be hard to fix by model elaboration alone and the Cut posterior and SMI offer a way round this. Information entering the analysis from misspecified modules is controlled by an influence parameter $\eta$ related to the learning rate. This paper contains two substantial new methods. First, we give variational methods for approximating the Cut and SMI posteriors which are adapted to the inferential goals of evidence combination. We parameterise a family of variational posteriors using a Normalising Flow for accurate approximation and end-to-end training. Secondly, we show that analysis of models with multiple cuts is feasible using a new Variational Meta-Posterior. This approximates a family of SMI posteriors indexed by $\eta$ using a single set of variational parameters.
Comments: 41 pages including bibliography, 9 figures. Supplement 18 pages. Code reproducing results this https URL
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)
MSC classes: 62F15 (Primary) 62C10, 62-08 (Secondary)
Cite as: arXiv:2204.00296 [stat.ML]
  (or arXiv:2204.00296v1 [stat.ML] for this version)

Submission history

From: Geoff Nicholls [view email]
[v1] Fri, 1 Apr 2022 09:01:20 GMT (8615kb,D)

Link back to: arXiv, form interface, contact.