Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Contrastive Mixture of Posteriors for Counterfactual Inference, Data Integration and Fairness
(Submitted on 15 Jun 2021 (v1), last revised 26 Jun 2022 (this version, v4))
Abstract: Learning meaningful representations of data that can address challenges such as batch effect correction and counterfactual inference is a central problem in many domains including computational biology. Adopting a Conditional VAE framework, we show that marginal independence between the representation and a condition variable plays a key role in both of these challenges. We propose the Contrastive Mixture of Posteriors (CoMP) method that uses a novel misalignment penalty defined in terms of mixtures of the variational posteriors to enforce this independence in latent space. We show that CoMP has attractive theoretical properties compared to previous approaches, and we prove counterfactual identifiability of CoMP under additional assumptions. We demonstrate state-of-the-art performance on a set of challenging tasks including aligning human tumour samples with cancer cell-lines, predicting transcriptome-level perturbation responses, and batch correction on single-cell RNA sequencing data. We also find parallels to fair representation learning and demonstrate that CoMP is competitive on a common task in the field.
Submission history
From: Adam Foster [view email][v1] Tue, 15 Jun 2021 14:04:55 GMT (12063kb,D)
[v2] Thu, 3 Feb 2022 15:52:06 GMT (5125kb,D)
[v3] Mon, 20 Jun 2022 14:42:49 GMT (5128kb,D)
[v4] Sun, 26 Jun 2022 15:05:18 GMT (5127kb,D)
Link back to: arXiv, form interface, contact.