We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.RO

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Learning from Simulation, Racing in Reality

Abstract: We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation using a relatively simple vehicle model, including model randomization, can be successfully transferred to the real robotic setup. We achieve this by using novel policy output regularization approach and a lifted action space which enables smooth actions but still aggressive race car driving. We show that this regularized policy does outperform the Soft Actor Critic (SAC) baseline method, both in simulation and on the real car, but it is still outperformed by a Model Predictive Controller (MPC) state of the art method. The refinement of the policy with three hours of real-world interaction data allows the reinforcement learning policy to achieve lap times similar to the MPC controller while reducing track constraint violations by 50%.
Comments: Presented at ICRA 2021. For associated video, see this https URL
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Systems and Control (eess.SY)
Cite as: arXiv:2011.13332 [cs.RO]
  (or arXiv:2011.13332v2 [cs.RO] for this version)

Submission history

From: Eugenio Chisari [view email]
[v1] Thu, 26 Nov 2020 14:58:49 GMT (3592kb,D)
[v2] Fri, 7 May 2021 08:21:06 GMT (3592kb,D)

Link back to: arXiv, form interface, contact.