Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Fixed Points of Belief Propagation -- An Analysis via Polynomial Homotopy Continuation
(Submitted on 20 May 2016 (v1), revised 24 Aug 2016 (this version, v2), latest version 30 May 2017 (v3))
Abstract: Belief propagation (BP) is an iterative method to perform approximate inference on arbitrary graphical models. Whether BP converges and if the solution is a unique fixed point depends on both, the structure and the parametrization of the model. To understand this dependence we are interested in finding \emph{all} fixed points. In this work, we formulate BP as a set of polynomial equations, the solutions of which correspond to the BP fixed points. We apply the numerical polynomial-homotopy-continuation (NPHC) method to solve such systems. It is commonly believed that uniqueness of BP fixed points implies convergence to this fixed point. Contrary to this conjecture, we find graphs for which BP fails to converge, even though a unique fixed point exists. Moreover, we show that this fixed point gives a good approximation of the exact marginal distribution.
Submission history
From: Christian Knoll [view email][v1] Fri, 20 May 2016 17:42:03 GMT (308kb,D)
[v2] Wed, 24 Aug 2016 15:19:00 GMT (148kb)
[v3] Tue, 30 May 2017 14:05:56 GMT (145kb,D)
Link back to: arXiv, form interface, contact.