We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Causal Discovery using Compression-Complexity Measures

Abstract: Causal inference is one of the most fundamental problems across all domains of science. We address the problem of inferring a causal direction from two observed discrete symbolic sequences $X$ and $Y$. We present a framework which relies on lossless compressors for inferring context-free grammars (CFGs) from sequence pairs and quantifies the extent to which the grammar inferred from one sequence compresses the other sequence. We infer $X$ causes $Y$ if the grammar inferred from $X$ better compresses $Y$ than in the other direction. To put this notion to practice, we propose three models that use the Compression-Complexity Measures (CCMs) - Lempel-Ziv (LZ) complexity and Effort-To-Compress (ETC) to infer CFGs and discover causal directions without demanding temporal structures. We evaluate these models on synthetic and real-world benchmarks and empirically observe performances competitive with current state-of-the-art methods. Lastly, we present two unique applications of the proposed models for causal inference directly from pairs of genome sequences belonging to the SARS-CoV-2 virus. Using a large number of sequences, we show that our models capture directed causal information exchange between sequence pairs, presenting novel opportunities for addressing key issues such as contact-tracing, motif discovery, evolution of virulence and pathogenicity in future applications.
Comments: Accepted version with major revisions to results and discussion. 17 pages, 9 figures
Subjects: Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)
MSC classes: 62D20 (Primary) 68P30, 68Q30, 94A17 (Secondary)
Journal reference: Pranay SY, & Nagaraj, N. (2021). Causal discovery using compression-complexity measures. Journal of Biomedical Informatics, 103724
DOI: 10.1016/j.jbi.2021.103724
Cite as: arXiv:2010.09336 [cs.LG]
  (or arXiv:2010.09336v3 [cs.LG] for this version)

Submission history

From: Pranay Yadav [view email]
[v1] Mon, 19 Oct 2020 09:19:56 GMT (319kb,D)
[v2] Thu, 22 Oct 2020 11:46:08 GMT (319kb,D)
[v3] Wed, 17 Mar 2021 10:45:26 GMT (400kb,D)

Link back to: arXiv, form interface, contact.