Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Reinforcing Adversarial Robustness using Model Confidence Induced by Adversarial Training
(Submitted on 21 Nov 2017 (v1), last revised 8 Jun 2018 (this version, v3))
Abstract: In this paper we study leveraging confidence information induced by adversarial training to reinforce adversarial robustness of a given adversarially trained model. A natural measure of confidence is $\|F({\bf x})\|_\infty$ (i.e. how confident $F$ is about its prediction?). We start by analyzing an adversarial training formulation proposed by Madry et al.. We demonstrate that, under a variety of instantiations, an only somewhat good solution to their objective induces confidence to be a discriminator, which can distinguish between right and wrong model predictions in a neighborhood of a point sampled from the underlying distribution. Based on this, we propose Highly Confident Near Neighbor (${\tt HCNN}$), a framework that combines confidence information and nearest neighbor search, to reinforce adversarial robustness of a base model. We give algorithms in this framework and perform a detailed empirical study. We report encouraging experimental results that support our analysis, and also discuss problems we observed with existing adversarial training.
Submission history
From: Xi Wu [view email][v1] Tue, 21 Nov 2017 19:15:05 GMT (75kb,D)
[v2] Mon, 1 Jan 2018 20:12:55 GMT (77kb,D)
[v3] Fri, 8 Jun 2018 13:46:51 GMT (96kb)
Link back to: arXiv, form interface, contact.