We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Hierarchical Policies for Cluttered-Scene Grasping with Latent Plans

Abstract: 6D grasping in cluttered scenes is a longstanding problem in robotic manipulation. Open-loop manipulation pipelines may fail due to inaccurate state estimation, while most end-to-end grasping methods have not yet scaled to complex scenes with obstacles. In this work, we propose a new method for end-to-end learning of 6D grasping in cluttered scenes. Our hierarchical framework learns collision-free target-driven grasping based on partial point cloud observations. We learn an embedding space to encode expert grasping plans during training and a variational autoencoder to sample diverse grasping trajectories at test time. Furthermore, we train a critic network for plan selection and an option classifier for switching to an instance grasping policy through hierarchical reinforcement learning. We evaluate our method and compare against several baselines in simulation, as well as demonstrate that our latent planning can generalize to real-world cluttered-scene grasping tasks. Our videos and code can be found at this https URL .
Subjects: Robotics (cs.RO)
Cite as: arXiv:2107.01518 [cs.RO]
  (or arXiv:2107.01518v3 [cs.RO] for this version)

Submission history

From: Lirui Wang [view email]
[v1] Sun, 4 Jul 2021 01:26:48 GMT (5708kb,D)
[v2] Tue, 14 Sep 2021 22:00:02 GMT (4643kb,D)
[v3] Tue, 11 Jan 2022 16:34:33 GMT (9405kb,D)

Link back to: arXiv, form interface, contact.