We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure

Abstract: Beneficial to advanced computing devices, models with massive parameters are increasingly employed to extract more information to enhance the precision in describing and predicting the patterns of objective systems. This phenomenon is particularly pronounced in research domains associated with deep learning. However, investigations of causal relationships based on statistical and informational theories have posed an interesting and valuable challenge to large-scale models in the recent decade. Macroscopic models with fewer parameters can outperform their microscopic counterparts with more parameters in effectively representing the system. This valuable situation is called "Causal Emergence." This paper introduces a quantification framework, according to the Effective Information and Transition Probability Matrix, for assessing numerical conditions of Causal Emergence as theoretical constraints of its occurrence. Specifically, our results quantitatively prove the cause of Causal Emergence. By a particular coarse-graining strategy, optimizing uncertainty and asymmetry within the model's causal structure is significantly more influential than losing maximum information due to variations in model scales. Moreover, by delving into the potential exhibited by Partial Information Decomposition and Deep Learning networks in the study of Causal Emergence, we discuss potential application scenarios where our quantification framework could play a role in future investigations of Causal Emergence.
Comments: 18 pages, 14 figures
Subjects: Information Theory (cs.IT); Artificial Intelligence (cs.AI); Computational Physics (physics.comp-ph)
ACM classes: H.1.0; J.2; I.2.m
Cite as: arXiv:2212.01551 [cs.IT]
  (or arXiv:2212.01551v3 [cs.IT] for this version)

Submission history

From: Yutao Yue [view email]
[v1] Sat, 3 Dec 2022 06:35:54 GMT (909kb,D)
[v2] Fri, 3 Feb 2023 08:18:16 GMT (1250kb,D)
[v3] Thu, 7 Mar 2024 02:10:54 GMT (2923kb,D)

Link back to: arXiv, form interface, contact.