Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Neural Network Optimal Feedback Control with Guaranteed Local Stability
(Submitted on 1 May 2022 (v1), last revised 7 Oct 2022 (this version, v3))
Abstract: Recent research shows that supervised learning can be an effective tool for designing near-optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of neural network controllers is still not well understood. In particular, some neural networks with high test accuracy can fail to even locally stabilize the dynamic system. To address this challenge we propose several novel neural network architectures, which we show guarantee local asymptotic stability while retaining the approximation capacity to learn the optimal feedback policy semi-globally. The proposed architectures are compared against standard neural network feedback controllers through numerical simulations of two high-dimensional nonlinear optimal control problems: stabilization of an unstable Burgers-type partial differential equation, and altitude and course tracking for an unmanned aerial vehicle. The simulations demonstrate that standard neural networks can fail to stabilize the dynamics even when trained well, while the proposed architectures are always at least locally stabilizing and can achieve near-optimal performance.
Submission history
From: Tenavi Nakamura-Zimmerer [view email][v1] Sun, 1 May 2022 04:23:24 GMT (2950kb)
[v2] Thu, 4 Aug 2022 06:17:29 GMT (662kb)
[v3] Fri, 7 Oct 2022 01:15:52 GMT (2166kb)
Link back to: arXiv, form interface, contact.