References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort
(Submitted on 13 Apr 2021 (v1), last revised 20 Apr 2021 (this version, v2))
Abstract: We introduce DatasetGAN: an automatic procedure to generate massive datasets of high-quality semantically segmented images requiring minimal human effort. Current deep networks are extremely data-hungry, benefiting from training on large-scale datasets, which are time consuming to annotate. Our method relies on the power of recent GANs to generate realistic images. We show how the GAN latent code can be decoded to produce a semantic segmentation of the image. Training the decoder only needs a few labeled examples to generalize to the rest of the latent space, resulting in an infinite annotated dataset generator! These generated datasets can then be used for training any computer vision architecture just as real datasets are. As only a few images need to be manually segmented, it becomes possible to annotate images in extreme detail and generate datasets with rich object and part segmentations. To showcase the power of our approach, we generated datasets for 7 image segmentation tasks which include pixel-level labels for 34 human face parts, and 32 car parts. Our approach outperforms all semi-supervised baselines significantly and is on par with fully supervised methods, which in some cases require as much as 100x more annotated data as our method.
Submission history
From: Yuxuan Zhang [view email][v1] Tue, 13 Apr 2021 20:08:29 GMT (17310kb,D)
[v2] Tue, 20 Apr 2021 00:27:10 GMT (17310kb,D)
Link back to: arXiv, form interface, contact.