We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.SY

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Systems and Control

Title: Reachability analysis of neural networks using mixed monotonicity

Abstract: This paper presents a new reachability analysis approach to compute interval over-approximations of the output set of feedforward neural networks with input uncertainty. We adapt to neural networks an existing mixed-monotonicity method for the reachability analysis of dynamical systems and apply it to each partial network within the main network. This ensures that the intersection of the obtained results is the tightest interval over-approximation of the output of each layer that can be obtained using mixed-monotonicity on any partial network decomposition. Unlike other tools in the literature focusing on small classes of piecewise-affine or monotone activation functions, the main strength of our approach is its generality: it can handle neural networks with any Lipschitz-continuous activation function. In addition, the simplicity of our framework allows users to very easily add unimplemented activation functions, by simply providing the function, its derivative and the global argmin and argmax of the derivative. Our algorithm is compared to five other interval-based tools (Interval Bound Propagation, ReluVal, Neurify, VeriNet, CROWN) on both existing benchmarks and two sets of small and large randomly generated networks for four activation functions (ReLU, TanH, ELU, SiLU).
Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG)
Journal reference: IEEE Control Systems Letters, Volume 6, Pages 3068-3073, 2022
DOI: 10.1109/LCSYS.2022.3182547
Cite as: arXiv:2111.07683 [eess.SY]
  (or arXiv:2111.07683v3 [eess.SY] for this version)

Submission history

From: Pierre-Jean Meyer [view email]
[v1] Mon, 15 Nov 2021 11:35:18 GMT (78kb,D)
[v2] Thu, 17 Mar 2022 10:31:35 GMT (104kb,D)
[v3] Thu, 23 Jun 2022 11:04:05 GMT (108kb,D)

Link back to: arXiv, form interface, contact.