We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Strengthening Probabilistic Graphical Models: The Purge-and-merge Algorithm

Abstract: Probabilistic graphical models (PGMs) are powerful tools for solving systems of complex relationships over a variety of probability distributions. However, while tree-structured PGMs always result in efficient and exact solutions, inference on graph (or loopy) structured PGMs is not guaranteed to discover the optimal solutions. It is in principle possible to convert loopy PGMs to an equivalent tree structure, but this is usually impractical for interesting problems due to exponential blow-up. To address this, we developed the purge-and-merge algorithm. This algorithm iteratively nudges a malleable graph structure towards a tree structure by selectively merging factors. The merging process is designed to avoid exponential blow-up by way of sparse structures from which redundancy is purged as the algorithm progresses. We set up tasks to test the algorithm on constraint-satisfaction puzzles such as Sudoku, Fill-a-pix, and Kakuro, and it outperformed other PGM-based approaches reported in the literature. While the tasks we set focussed on the binary logic of CSP, we believe the purge-and-merge algorithm could be extended to general PGM inference.
Subjects: Machine Learning (cs.LG)
DOI: 10.1109/ACCESS.2021.3124760
Cite as: arXiv:2110.00091 [cs.LG]
  (or arXiv:2110.00091v3 [cs.LG] for this version)

Submission history

From: Simon Streicher [view email]
[v1] Thu, 30 Sep 2021 21:20:52 GMT (580kb,D)
[v2] Sat, 30 Oct 2021 06:23:29 GMT (4141kb,D)
[v3] Tue, 9 Nov 2021 10:07:59 GMT (4146kb,D)

Link back to: arXiv, form interface, contact.