Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Randomization matters. How to defend against strong adversarial attacks
(Submitted on 26 Feb 2020 (v1), last revised 6 Jan 2021 (this version, v5))
Abstract: Is there a classifier that ensures optimal robustness against all adversarial attacks? This paper answers this question by adopting a game-theoretic point of view. We show that adversarial attacks and defenses form an infinite zero-sum game where classical results (e.g. Sion theorem) do not apply. We demonstrate the non-existence of a Nash equilibrium in our game when the classifier and the Adversary are both deterministic, hence giving a negative answer to the above question in the deterministic regime. Nonetheless, the question remains open in the randomized regime. We tackle this problem by showing that, undermild conditions on the dataset distribution, any deterministic classifier can be outperformed by a randomized one. This gives arguments for using randomization, and leads us to a new algorithm for building randomized classifiers that are robust to strong adversarial attacks. Empirical results validate our theoretical analysis, and show that our defense method considerably outperforms Adversarial Training against state-of-the-art attacks.
Submission history
From: Raphael Ettedgui [view email][v1] Wed, 26 Feb 2020 15:31:31 GMT (159kb,D)
[v2] Thu, 23 Jul 2020 11:27:26 GMT (227kb,D)
[v3] Thu, 10 Dec 2020 10:11:46 GMT (242kb,D)
[v4] Tue, 5 Jan 2021 12:52:40 GMT (245kb,D)
[v5] Wed, 6 Jan 2021 12:53:03 GMT (633kb,D)
Link back to: arXiv, form interface, contact.