Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning Independent Causal Mechanisms
(Submitted on 4 Dec 2017 (v1), last revised 8 Sep 2018 (this version, v5))
Abstract: Statistical learning relies upon data sampled from a distribution, and we usually do not care what actually generated it in the first place. From the point of view of causal modeling, the structure of each distribution is induced by physical mechanisms that give rise to dependences between observables. Mechanisms, however, can be meaningful autonomous modules of generative models that make sense beyond a particular entailed data distribution, lending themselves to transfer between problems. We develop an algorithm to recover a set of independent (inverse) mechanisms from a set of transformed data points. The approach is unsupervised and based on a set of experts that compete for data generated by the mechanisms, driving specialization. We analyze the proposed method in a series of experiments on image data. Each expert learns to map a subset of the transformed data back to a reference distribution. The learned mechanisms generalize to novel domains. We discuss implications for transfer learning and links to recent trends in generative modeling.
Submission history
From: Niki Kilbertus [view email][v1] Mon, 4 Dec 2017 09:06:15 GMT (517kb,D)
[v2] Sat, 9 Dec 2017 00:34:00 GMT (517kb,D)
[v3] Sun, 21 Jan 2018 15:44:45 GMT (525kb,D)
[v4] Mon, 19 Feb 2018 18:28:56 GMT (1114kb,D)
[v5] Sat, 8 Sep 2018 08:17:44 GMT (831kb,D)
Link back to: arXiv, form interface, contact.