We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.RO

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Improving the Robustness of Reinforcement Learning Policies with $\mathcal{L}_{1}$ Adaptive Control

Abstract: A reinforcement learning (RL) control policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. For controlling systems with continuous state and action spaces, we propose an add-on approach to robustifying a pre-trained RLpolicy by augmenting it with an $\mathcal{L}_{1}$ adaptive controller ($ \mathcal{L}_{1}$AC). Leveraging the capability of an $\mathcal{L}_{1}$AC for fast estimation and active compensation of dynamic variations, the proposed approach can improve the robustness of an RL policy which is trained either in a simulator or in the real world without consideration of a broad class of dynamic variations. Numerical and real-world experiments empirically demonstrate the efficacy of the proposed approach in robustifying RL policies trained using both model-free and model-based methods. A video for the experiments on a real Pendubot setup is availableatthis https URL
Comments: arXiv admin note: substantial text overlap with arXiv:2106.02249
Subjects: Robotics (cs.RO)
Cite as: arXiv:2112.01953 [cs.RO]
  (or arXiv:2112.01953v4 [cs.RO] for this version)

Submission history

From: Yikun Cheng [view email]
[v1] Fri, 3 Dec 2021 15:00:30 GMT (7166kb,D)
[v2] Mon, 6 Dec 2021 04:05:11 GMT (7167kb,D)
[v3] Tue, 7 Dec 2021 03:38:17 GMT (7166kb,D)
[v4] Mon, 3 Jan 2022 17:03:31 GMT (7166kb,D)

Link back to: arXiv, form interface, contact.