We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: A causal framework for distribution generalization

Abstract: We consider the problem of predicting a response $Y$ from a set of covariates $X$ when test and training distributions differ. Since such differences may have causal explanations, we consider test distributions that emerge from interventions in a structural causal model, and focus on minimizing the worst-case risk. Causal regression models, which regress the response on its direct causes, remain unchanged under arbitrary interventions on the covariates, but they are not always optimal in the above sense. For example, for linear models and bounded interventions, alternative solutions have been shown to be minimax prediction optimal. We introduce the formal framework of distribution generalization that allows us to analyze the above problem in partially observed nonlinear models for both direct interventions on $X$ and interventions that occur indirectly via exogenous variables $A$. It takes into account that, in practice, minimax solutions need to be identified from data. Our framework allows us to characterize under which class of interventions the causal function is minimax optimal. We prove sufficient conditions for distribution generalization and present corresponding impossibility results. We propose a practical method, NILE, that achieves distribution generalization in a nonlinear IV setting with linear extrapolation. We prove consistency and present empirical results.
Comments: 52 pages, 8 figures, 2 tables. To be published in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Subjects: Methodology (stat.ME)
MSC classes: Primary 62Gxx, secondary 62G35, 62G08, 62D20
Cite as: arXiv:2006.07433 [stat.ME]
  (or arXiv:2006.07433v3 [stat.ME] for this version)

Submission history

From: Rune Christiansen [view email]
[v1] Fri, 12 Jun 2020 19:24:02 GMT (915kb,D)
[v2] Fri, 4 Sep 2020 20:00:08 GMT (918kb,D)
[v3] Tue, 17 Aug 2021 19:00:01 GMT (1402kb,D)

Link back to: arXiv, form interface, contact.