References & Citations
Statistics > Methodology
Title: A Geometric Variational Approach to Bayesian Inference
(Submitted on 31 Jul 2017 (v1), last revised 27 Mar 2019 (this version, v2))
Abstract: We propose a novel Riemannian geometric framework for variational inference in Bayesian models based on the nonparametric Fisher-Rao metric on the manifold of probability density functions. Under the square-root density representation, the manifold can be identified with the positive orthant of the unit hypersphere in L2, and the Fisher-Rao metric reduces to the standard L2 metric. Exploiting such a Riemannian structure, we formulate the task of approximating the posterior distribution as a variational problem on the hypersphere based on the alpha-divergence. This provides a tighter lower bound on the marginal distribution when compared to, and a corresponding upper bound unavailable with, approaches based on the Kullback-Leibler divergence. We propose a novel gradient-based algorithm for the variational problem based on Frechet derivative operators motivated by the geometry of the Hilbert sphere, and examine its properties. Through simulations and real-data applications, we demonstrate the utility of the proposed geometric framework and algorithm on several Bayesian models.
Submission history
From: Sebastian Kurtek [view email][v1] Mon, 31 Jul 2017 03:59:00 GMT (6959kb,D)
[v2] Wed, 27 Mar 2019 18:32:39 GMT (7699kb,D)
Link back to: arXiv, form interface, contact.