We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Direct-Effect Risk Minimization for Domain Generalization

Abstract: We study the problem of out-of-distribution (o.o.d.) generalization where spurious correlations of attributes vary across training and test domains. This is known as the problem of correlation shift and has posed concerns on the reliability of machine learning. In this work, we introduce the concepts of direct and indirect effects from causal inference to the domain generalization problem. We argue that models that learn direct effects minimize the worst-case risk across correlation-shifted domains. To eliminate the indirect effects, our algorithm consists of two stages: in the first stage, we learn an indirect-effect representation by minimizing the prediction error of domain labels using the representation and the class labels; in the second stage, we remove the indirect effects learned in the first stage by matching each data with another data of similar indirect-effect representation but of different class labels in the training and validation phase. Our approach is shown to be compatible with existing methods and improve the generalization performance of them on correlation-shifted datasets. Experiments on 5 correlation-shifted datasets and the DomainBed benchmark verify the effectiveness of our approach.
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
Cite as: arXiv:2211.14594 [cs.LG]
  (or arXiv:2211.14594v4 [cs.LG] for this version)

Submission history

From: Yuhui Li [view email]
[v1] Sat, 26 Nov 2022 15:35:36 GMT (559kb,D)
[v2] Tue, 31 Jan 2023 15:52:23 GMT (559kb,D)
[v3] Wed, 1 Feb 2023 11:22:57 GMT (560kb,D)
[v4] Thu, 16 Mar 2023 03:21:22 GMT (652kb,D)

Link back to: arXiv, form interface, contact.