References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Large-scale Unsupervised Semantic Segmentation
(Submitted on 6 Jun 2021 (v1), last revised 3 Nov 2022 (this version, v3))
Abstract: Empowered by large datasets, e.g., ImageNet, unsupervised learning on large-scale data has enabled significant advances for classification tasks. However, whether the large-scale unsupervised semantic segmentation can be achieved remains unknown. There are two major challenges: i) we need a large-scale benchmark for assessing algorithms; ii) we need to develop methods to simultaneously learn category and shape representation in an unsupervised manner. In this work, we propose a new problem of large-scale unsupervised semantic segmentation (LUSS) with a newly created benchmark dataset to help the research progress. Building on the ImageNet dataset, we propose the ImageNet-S dataset with 1.2 million training images and 50k high-quality semantic segmentation annotations for evaluation. Our benchmark has a high data diversity and a clear task objective. We also present a simple yet effective method that works surprisingly well for LUSS. In addition, we benchmark related un/weakly/fully supervised methods accordingly, identifying the challenges and possible directions of LUSS. The benchmark and source code is publicly available at this https URL
Submission history
From: Shanghua Gao [view email][v1] Sun, 6 Jun 2021 15:02:11 GMT (2881kb,D)
[v2] Sun, 30 Jan 2022 13:07:37 GMT (2289kb,D)
[v3] Thu, 3 Nov 2022 12:31:02 GMT (1943kb,D)
Link back to: arXiv, form interface, contact.