We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Barycentric-alignment and invertibility for domain generalization

Abstract: We revisit Domain Generalization (DG) problem, where the hypotheses are composed of a common representation mapping followed by a labeling function. Popular DG methods optimize a well-known upper bound to the risk in the unseen domain. However, the bound contains a term that is not optimized due to its dual dependence on the representation mapping and the unknown optimal labeling function for the unseen domain. We derive a new upper bound free of terms having such dual dependence by imposing mild assumptions on the loss function and an invertibility requirement on the representation map when restricted to the low-dimensional data manifold. The derivation leverages old and recent transport inequalities that link optimal transport metrics with information-theoretic measures. Our bound motivates a new algorithm for DG comprising Wasserstein-2 barycenter cost for feature alignment and mutual information or autoencoders for enforcing approximate invertibility. Experiments on several datasets demonstrate superior performance compared to the state-of-the-art DG algorithms.
Comments: Results are updated
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2109.01902 [cs.LG]
  (or arXiv:2109.01902v4 [cs.LG] for this version)

Submission history

From: Boyang Lyu [view email]
[v1] Sat, 4 Sep 2021 16:57:36 GMT (83kb,D)
[v2] Sat, 23 Oct 2021 00:38:15 GMT (259kb,D)
[v3] Tue, 26 Oct 2021 01:08:57 GMT (265kb,D)
[v4] Wed, 2 Feb 2022 03:55:40 GMT (498kb,D)

Link back to: arXiv, form interface, contact.