We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Conditional entropy minimization principle for learning domain invariant representation features

Abstract: Invariance-principle-based methods such as Invariant Risk Minimization (IRM), have recently emerged as promising approaches for Domain Generalization (DG). Despite promising theory, such approaches fail in common classification tasks due to the mixing of true invariant features and spurious invariant features. To address this, we propose a framework based on the conditional entropy minimization (CEM) principle to filter-out the spurious invariant features leading to a new algorithm with a better generalization capability. We show that our proposed approach is closely related to the well-known Information Bottleneck (IB) framework and prove that under certain assumptions, entropy minimization can exactly recover the true invariant features. Our approach provides competitive classification accuracy compared to recent theoretically-principled state-of-the-art alternatives across several DG datasets.
Comments: 10 pages, this paper was accepted at 26th International Conference on Pattern Recognition (ICPR-2022)
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
Cite as: arXiv:2201.10460 [cs.LG]
  (or arXiv:2201.10460v4 [cs.LG] for this version)

Submission history

From: Thuan Nguyen [view email]
[v1] Tue, 25 Jan 2022 17:02:12 GMT (125kb)
[v2] Mon, 7 Mar 2022 21:37:18 GMT (125kb)
[v3] Wed, 20 Apr 2022 22:52:45 GMT (130kb)
[v4] Sun, 10 Jul 2022 02:28:55 GMT (126kb)

Link back to: arXiv, form interface, contact.