Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Regret Analysis of Learning-Based MPC with Partially-Unknown Cost Function
(Submitted on 4 Aug 2021 (v1), last revised 27 Jan 2023 (this version, v2))
Abstract: The exploration/exploitation trade-off is an inherent challenge in data-driven adaptive control. Though this trade-off has been studied for multi-armed bandits (MAB's) and reinforcement learning for linear systems; it is less well-studied for learning-based control of nonlinear systems. A significant theoretical challenge in the nonlinear setting is that there is no explicit characterization of an optimal controller for a given set of cost and system parameters. We propose the use of a finite-horizon oracle controller with full knowledge of parameters as a reasonable surrogate to optimal controller. This allows us to develop policies in the context of learning-based MPC and MAB's and conduct a control-theoretic analysis using techniques from MPC- and optimization-theory to show these policies achieve low regret with respect to this finite-horizon oracle. Our simulations exhibit the low regret of our policy on a heating, ventilation, and air-conditioning model with partially-unknown cost function.
Submission history
From: Ilgin Dogan [view email][v1] Wed, 4 Aug 2021 22:43:51 GMT (1738kb,D)
[v2] Fri, 27 Jan 2023 14:54:57 GMT (1158kb,D)
Link back to: arXiv, form interface, contact.