Current browse context:
eess.SY
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Systems and Control
Title: Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems
(Submitted on 16 Jul 2021 (v1), last revised 5 Dec 2021 (this version, v3))
Abstract: This paper studies the adaptive optimal stationary control of continuous-time linear stochastic systems with both additive and multiplicative noises, using reinforcement learning techniques. Based on policy iteration, a novel off-policy reinforcement learning algorithm, named optimistic least-squares-based policy iteration, is proposed which is able to find iteratively near-optimal policies of the adaptive optimal stationary control problem directly from input/state data without explicitly identifying any system matrices, starting from an initial admissible control policy. The solutions given by the proposed optimistic least-squares-based policy iteration are proved to converge to a small neighborhood of the optimal solution with probability one, under mild conditions. The application of the proposed algorithm to a triple inverted pendulum example validates its feasibility and effectiveness.
Submission history
From: Bo Pang [view email][v1] Fri, 16 Jul 2021 09:27:02 GMT (96kb,D)
[v2] Tue, 20 Jul 2021 03:47:32 GMT (99kb,D)
[v3] Sun, 5 Dec 2021 10:07:16 GMT (737kb,D)
Link back to: arXiv, form interface, contact.