We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Domain Invariant Adversarial Learning

Abstract: The phenomenon of adversarial examples illustrates one of the most basic vulnerabilities of deep neural networks. Among the variety of techniques introduced to surmount this inherent weakness, adversarial training has emerged as the most effective strategy for learning robust models. Typically, this is achieved by balancing robust and natural objectives. In this work, we aim to further optimize the trade-off between robust and standard accuracy by enforcing a domain-invariant feature representation. We present a new adversarial training method, Domain Invariant Adversarial Learning (DIAL), which learns a feature representation that is both robust and domain invariant. DIAL uses a variant of Domain Adversarial Neural Network (DANN) on the natural domain and its corresponding adversarial domain. In the case where the source domain consists of natural examples and the target domain is the adversarially perturbed examples, our method learns a feature representation constrained not to discriminate between the natural and adversarial examples, and can therefore achieve a more robust representation. DIAL is a generic and modular technique that can be easily incorporated into any adversarial training method. Our experiments indicate that incorporating DIAL in the adversarial training process improves both robustness and standard accuracy.
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Journal reference: Transactions of Machine Learning Research (2022)
Cite as: arXiv:2104.00322 [cs.LG]
  (or arXiv:2104.00322v4 [cs.LG] for this version)

Submission history

From: Matan Levi [view email]
[v1] Thu, 1 Apr 2021 08:04:10 GMT (2276kb,D)
[v2] Sun, 20 Jun 2021 14:23:20 GMT (2429kb,D)
[v3] Wed, 6 Oct 2021 21:35:42 GMT (3620kb,D)
[v4] Tue, 13 Sep 2022 10:03:47 GMT (6807kb,D)

Link back to: arXiv, form interface, contact.