References & Citations
Computer Science > Robotics
Title: Stability-Guaranteed Reinforcement Learning for Contact-rich Manipulation
(Submitted on 22 Apr 2020 (v1), last revised 27 Sep 2020 (this version, v2))
Abstract: Reinforcement learning (RL) has had its fair share of success in contact-rich manipulation tasks but it still lags behind in benefiting from advances in robot control theory such as impedance control and stability guarantees. Recently, the concept of variable impedance control (VIC) was adopted into RL with encouraging results. However, the more important issue of stability remains unaddressed. To clarify the challenge in stable RL, we introduce the term all-the-time-stability that unambiguously means that every possible rollout will be stability certified. Our contribution is a model-free RL method that not only adopts VIC but also achieves all-the-time-stability. Building on a recently proposed stable VIC controller as the policy parameterization, we introduce a novel policy search algorithm that is inspired by Cross-Entropy Method and inherently guarantees stability. Our experimental studies confirm the feasibility and usefulness of stability guarantee and also features, to the best of our knowledge, the first successful application of RL with all-the-time-stability on the benchmark problem of peg-in-hole.
Submission history
From: Shahbaz Abdul Khader [view email][v1] Wed, 22 Apr 2020 22:18:27 GMT (8943kb,D)
[v2] Sun, 27 Sep 2020 11:17:52 GMT (10160kb,D)
Link back to: arXiv, form interface, contact.