Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Non-Euclidean Monotone Operator Theory with Applications to Recurrent Neural Networks
(Submitted on 4 Apr 2022 (v1), last revised 18 Jul 2022 (this version, v2))
Abstract: We provide a novel transcription of monotone operator theory to the non-Euclidean finite-dimensional spaces $\ell_1$ and $\ell_{\infty}$. We first establish properties of mappings which are monotone with respect to the non-Euclidean norms $\ell_1$ or $\ell_{\infty}$. In analogy with their Euclidean counterparts, mappings which are monotone with respect to a non-Euclidean norm are amenable to numerous algorithms for computing their zeros. We demonstrate that several classic iterative methods for computing zeros of monotone operators are directly applicable in the non-Euclidean framework. We present a case-study in the equilibrium computation of recurrent neural networks and demonstrate that casting the computation as a suitable operator splitting problem improves convergence rates.
Submission history
From: Alexander Davydov [view email][v1] Mon, 4 Apr 2022 22:46:36 GMT (298kb,D)
[v2] Mon, 18 Jul 2022 17:37:00 GMT (298kb,D)
Link back to: arXiv, form interface, contact.