We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Conditional entropy minimization principle for learning domain invariant representation features

Abstract: Invariance principle-based methods, for example, Invariant Risk Minimization (IRM), have recently emerged as promising approaches for Domain Generalization (DG). Despite the promising theory, invariance principle-based approaches fail in common classification tasks due to the mixture of the true invariant features and the spurious invariant features. In this paper, we propose a framework based on the conditional entropy minimization principle to filter out the spurious invariant features leading to a new algorithm with a better generalization capability. We theoretically prove that under some particular assumptions, the representation function can precisely recover the true invariant features. In addition, we also show that the proposed approach is closely related to the well-known Information Bottleneck framework. Both the theoretical and numerical results are provided to justify our approach.
Comments: 7 pages
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
Cite as: arXiv:2201.10460 [cs.LG]
  (or arXiv:2201.10460v1 [cs.LG] for this version)

Submission history

From: Thuan Nguyen [view email]
[v1] Tue, 25 Jan 2022 17:02:12 GMT (125kb)
[v2] Mon, 7 Mar 2022 21:37:18 GMT (125kb)
[v3] Wed, 20 Apr 2022 22:52:45 GMT (130kb)

Link back to: arXiv, form interface, contact.