Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Adversarial Defense via Data Dependent Activation Function and Total Variation Minimization
(Submitted on 23 Sep 2018 (v1), last revised 29 Apr 2020 (this version, v3))
Abstract: We improve the robustness of Deep Neural Net (DNN) to adversarial attacks by using an interpolating function as the output activation. This data-dependent activation remarkably improves both the generalization and robustness of DNN. In the CIFAR10 benchmark, we raise the robust accuracy of the adversarially trained ResNet20 from $\sim 46\%$ to $\sim 69\%$ under the state-of-the-art Iterative Fast Gradient Sign Method (IFGSM) based adversarial attack. When we combine this data-dependent activation with total variation minimization on adversarial images and training data augmentation, we achieve an improvement in robust accuracy by 38.9$\%$ for ResNet56 under the strongest IFGSM attack. Furthermore, We provide an intuitive explanation of our defense by analyzing the geometry of the feature space.
Submission history
From: Bao Wang [view email][v1] Sun, 23 Sep 2018 02:33:31 GMT (2467kb,D)
[v2] Tue, 27 Nov 2018 17:54:21 GMT (1811kb,D)
[v3] Wed, 29 Apr 2020 07:05:16 GMT (1813kb,D)
Link back to: arXiv, form interface, contact.