We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Domain Knowledge Alleviates Adversarial Attacks in Multi-Label Classifiers

Abstract: Adversarial attacks on machine learning-based classifiers, along with defense mechanisms, have been widely studied in the context of single-label classification problems. In this paper, we shift the attention to multi-label classification, where the availability of domain knowledge on the relationships among the considered classes may offer a natural way to spot incoherent predictions, i.e., predictions associated to adversarial examples lying outside of the training data distribution. We explore this intuition in a framework in which first-order logic knowledge is converted into constraints and injected into a semi-supervised learning problem. Within this setting, the constrained classifier learns to fulfill the domain knowledge over the marginal distribution, and can naturally reject samples with incoherent predictions. Even though our method does not exploit any knowledge of attacks during training, our experimental analysis surprisingly unveils that domain-knowledge constraints can help detect adversarial examples effectively, especially if such constraints are not known to the attacker.
Comments: Accepted for publications in IEEE TPAMI journal
Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)
Journal reference: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 12, pp. 9944-9959, 1 Dec. 2022
DOI: 10.1109/TPAMI.2021.3137564
Cite as: arXiv:2006.03833 [cs.LG]
  (or arXiv:2006.03833v4 [cs.LG] for this version)

Submission history

From: Gabriele Ciravegna Dr. [view email]
[v1] Sat, 6 Jun 2020 10:24:54 GMT (1075kb,D)
[v2] Thu, 20 Aug 2020 09:02:06 GMT (1076kb,D)
[v3] Thu, 15 Apr 2021 13:26:41 GMT (5728kb,D)
[v4] Wed, 29 Dec 2021 11:45:28 GMT (7481kb,D)

Link back to: arXiv, form interface, contact.