We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

physics.comp-ph

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Physics > Computational Physics

Title: Closely estimating the entropy of sparse graph models

Authors: Edward D. Lee
Abstract: We introduce an algorithm for estimating the entropy of pairwise, probabilistic graph models by leveraging bridges between social communities and an accurate entropy estimator on sparse samples. We propose using a measure of investment from the sociological literature, Burt's structural constraint, as a heuristic for identifying bridges that partition a graph into conditionally independent components. We combine this heuristic with the Nemenman-Shafee-Bialek entropy estimator to obtain a faster and more accurate estimator. We demonstrate it on the pairwise maximum entropy, or Ising, models of judicial voting, to improve na\"ive entropy estimates. We use our algorithm to estimate the partition function closely, which we then apply to the problem of model selection, where estimating the likelihood is difficult. This serves as an improvement over existing methods that rely on point correlation functions to test fit can be extended to other graph models with a straightforward modification of the open-source implementation.
Subjects: Computational Physics (physics.comp-ph); Data Analysis, Statistics and Probability (physics.data-an)
Cite as: arXiv:2301.04768 [physics.comp-ph]
  (or arXiv:2301.04768v1 [physics.comp-ph] for this version)

Submission history

From: Edward D Lee [view email]
[v1] Thu, 12 Jan 2023 00:13:55 GMT (1502kb,D)

Link back to: arXiv, form interface, contact.