We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: A Domain-Theoretic Framework for Robustness Analysis of Neural Networks

Abstract: A domain-theoretic framework is presented for validated robustness analysis of neural networks. First, global robustness of a general class of networks is analyzed. Then, using the fact that Edalat's domain-theoretic L-derivative coincides with Clarke's generalized gradient, the framework is extended for attack-agnostic local robustness analysis. The proposed framework is ideal for designing algorithms which are correct by construction. This claim is exemplified by developing a validated algorithm for estimation of Lipschitz constant of feedforward regressors. The completeness of the algorithm is proved over differentiable networks, and also over general position ReLU networks. Computability results are obtained within the framework of effectively given domains. Using the proposed domain model, differentiable and non-differentiable networks can be analyzed uniformly. The validated algorithm is implemented using arbitrary-precision interval arithmetic, and the results of some experiments are presented. The software implementation is truly validated, as it handles floating-point errors as well.
Comments: 35 pages, 10 figures, 3 tables
Subjects: Machine Learning (cs.LG)
MSC classes: 06B35, 68Q55, 49J52, 68T37
Cite as: arXiv:2203.00295 [cs.LG]
  (or arXiv:2203.00295v3 [cs.LG] for this version)

Submission history

From: Amin Farjudian [view email]
[v1] Tue, 1 Mar 2022 09:01:01 GMT (584kb,D)
[v2] Thu, 23 Jun 2022 10:53:50 GMT (555kb,D)
[v3] Mon, 9 Jan 2023 11:28:54 GMT (957kb,D)

Link back to: arXiv, form interface, contact.