References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: A survey on Semi-, Self- and Unsupervised Learning for Image Classification
(Submitted on 20 Feb 2020 (v1), last revised 25 May 2021 (this version, v5))
Abstract: While deep learning strategies achieve outstanding results in computer vision tasks, one issue remains: The current strategies rely heavily on a huge amount of labeled data. In many real-world problems, it is not feasible to create such an amount of labeled training data. Therefore, it is common to incorporate unlabeled data into the training process to reach equal results with fewer labels. Due to a lot of concurrent research, it is difficult to keep track of recent developments. In this survey, we provide an overview of often used ideas and methods in image classification with fewer labels. We compare 34 methods in detail based on their performance and their commonly used ideas rather than a fine-grained taxonomy. In our analysis, we identify three major trends that lead to future research opportunities. 1. State-of-the-art methods are scaleable to real-world applications in theory but issues like class imbalance, robustness, or fuzzy labels are not considered. 2. The degree of supervision which is needed to achieve comparable results to the usage of all labels is decreasing and therefore methods need to be extended to settings with a variable number of classes. 3. All methods share some common ideas but we identify clusters of methods that do not share many ideas. We show that combining ideas from different clusters can lead to better performance.
Submission history
From: Lars Schmarje [view email][v1] Thu, 20 Feb 2020 13:29:27 GMT (4887kb,D)
[v2] Fri, 26 Jun 2020 13:33:38 GMT (5814kb,D)
[v3] Fri, 24 Jul 2020 11:44:02 GMT (2914kb,D)
[v4] Thu, 11 Feb 2021 14:16:54 GMT (10524kb,D)
[v5] Tue, 25 May 2021 12:29:55 GMT (24302kb,D)
Link back to: arXiv, form interface, contact.