Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Multi-Task Domain Adaptation for Deep Learning of Instance Grasping from Simulation
(Submitted on 17 Oct 2017 (v1), last revised 4 Mar 2018 (this version, v2))
Abstract: Learning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by utilizing simulated robot experiments. Our neural network takes monocular RGB images and the instance segmentation mask of a specified target object as inputs, and predicts the probability of successfully grasping the specified object for each candidate motor command. The proposed transfer learning framework trains a model for instance grasping in simulation and uses a domain-adversarial loss to transfer the trained model to real robots using indiscriminate grasping data, which is available both in simulation and the real world. We evaluate our model in real-world robot experiments, comparing it with alternative model architectures as well as an indiscriminate grasping baseline.
Submission history
From: Kuan Fang [view email][v1] Tue, 17 Oct 2017 17:54:50 GMT (7674kb,D)
[v2] Sun, 4 Mar 2018 04:08:58 GMT (8679kb,D)
Link back to: arXiv, form interface, contact.