Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Diagnostics for Deep Neural Networks with Automated Copy/Paste Attacks
(Submitted on 18 Nov 2022 (v1), last revised 5 May 2023 (this version, v3))
Abstract: This paper considers the problem of helping humans exercise scalable oversight over deep neural networks (DNNs). Adversarial examples can be useful by helping to reveal weaknesses in DNNs, but they can be difficult to interpret or draw actionable conclusions from. Some previous works have proposed using human-interpretable adversarial attacks including copy/paste attacks in which one natural image pasted into another causes an unexpected misclassification. We build on these with two contributions. First, we introduce Search for Natural Adversarial Features Using Embeddings (SNAFUE) which offers a fully automated method for finding copy/paste attacks. Second, we use SNAFUE to red team an ImageNet classifier. We reproduce copy/paste attacks from previous works and find hundreds of other easily-describable vulnerabilities, all without a human in the loop. Code is available at this https URL
Submission history
From: Stephen Casper [view email][v1] Fri, 18 Nov 2022 04:32:59 GMT (35299kb,D)
[v2] Tue, 22 Nov 2022 18:57:25 GMT (35299kb,D)
[v3] Fri, 5 May 2023 06:52:05 GMT (16136kb,D)
Link back to: arXiv, form interface, contact.