Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Adversarial Training and Provable Robustness: A Tale of Two Objectives
(Submitted on 13 Aug 2020 (v1), last revised 1 Mar 2021 (this version, v3))
Abstract: We propose a principled framework that combines adversarial training and provable robustness verification for training certifiably robust neural networks. We formulate the training problem as a joint optimization problem with both empirical and provable robustness objectives and develop a novel gradient-descent technique that can eliminate bias in stochastic multi-gradients. We perform both theoretical analysis on the convergence of the proposed technique and experimental comparison with state-of-the-arts. Results on MNIST and CIFAR-10 show that our method can consistently match or outperform prior approaches for provable l infinity robustness. Notably, we achieve 6.60% verified test error on MNIST at epsilon = 0.3, and 66.57% on CIFAR-10 with epsilon = 8/255.
Submission history
From: Jiameng Fan [view email][v1] Thu, 13 Aug 2020 18:49:15 GMT (1391kb,D)
[v2] Wed, 30 Sep 2020 15:56:34 GMT (1397kb,D)
[v3] Mon, 1 Mar 2021 18:07:53 GMT (2156kb,D)
Link back to: arXiv, form interface, contact.