We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.stat-mech

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Statistical Mechanics

Title: Unique Information via Dependency Constraints

Abstract: The partial information decomposition (PID) is perhaps the leading proposal for resolving information shared between a set of sources and a target into redundant, synergistic, and unique constituents. Unfortunately, the PID framework has been hindered by a lack of a generally agreed-upon, multivariate method of quantifying the constituents. Here, we take a step toward rectifying this by developing a decomposition based on a new method that quantifies unique information. We first develop a broadly applicable method---the dependency decomposition---that delineates how statistical dependencies influence the structure of a joint distribution. The dependency decomposition then allows us to define a measure of the information about a target that can be uniquely attributed to a particular source as the least amount which the source-target statistical dependency can influence the information shared between the sources and the target. The result is the first measure that satisfies the core axioms of the PID framework while not satisfying the Blackwell relation, which depends on a particular interpretation of how the variables are related. This makes a key step forward to a practical PID.
Comments: 15 pages, 7 figures, 2 tables, 3 appendices; this http URL
Subjects: Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)
Cite as: arXiv:1709.06653 [cond-mat.stat-mech]
  (or arXiv:1709.06653v3 [cond-mat.stat-mech] for this version)

Submission history

From: James P. Crutchfield [view email]
[v1] Tue, 19 Sep 2017 21:36:28 GMT (356kb,D)
[v2] Sun, 29 Apr 2018 20:22:28 GMT (382kb,D)
[v3] Sat, 27 Oct 2018 17:48:17 GMT (466kb,D)

Link back to: arXiv, form interface, contact.