We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Constrained-Space Optimization and Reinforcement Learning for Complex Tasks

Abstract: Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints. This paper presents a constrained-space optimization and reinforcement learning scheme for managing complex tasks. Through interactions within the constrained space, the reinforcement learning agent is trained to optimize the manipulation skills according to a defined reward function. After learning, the optimal policy is derived from the well-trained reinforcement learning agent, which is then implemented to guide the robot to conduct tasks that are similar to the experts' demonstrations. The effectiveness of the proposed method is verified with a robotic suturing task, demonstrating that the learned policy outperformed the experts' demonstrations in terms of the smoothness of the joint motion and end-effector trajectories, as well as the overall task completion time.
Comments: Accepted for publication in RA-Letters and at ICRA 2020
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Journal reference: IEEE Robotics and Automation Letters, 5(2) (2020) 682-689
DOI: 10.1109/LRA.2020.2965392
Cite as: arXiv:2004.00716 [cs.RO]
  (or arXiv:2004.00716v1 [cs.RO] for this version)

Submission history

From: Ya-Yen Tsai [view email]
[v1] Wed, 1 Apr 2020 21:50:11 GMT (1415kb,D)

Link back to: arXiv, form interface, contact.