References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Unsupervised Continual Learning Via Pseudo Labels
(Submitted on 14 Apr 2021 (v1), last revised 30 Jul 2021 (this version, v3))
Abstract: Continual learning aims to learn new tasks incrementally using less computation and memory resources instead of retraining the model from scratch whenever new task arrives. However, existing approaches are designed in supervised fashion assuming all data from new tasks have been manually annotated, which are not practical for many real-life applications. In this work, we propose to use pseudo label instead of the ground truth to make continual learning feasible in unsupervised mode. The pseudo labels of new data are obtained by applying global clustering algorithm and we propose to use the model updated from last incremental step as the feature extractor. Due to the scarcity of existing work, we introduce a new benchmark experimental protocol for unsupervised continual learning of image classification task under class-incremental setting where no class label is provided for each incremental learning step. Our method is evaluated on the CIFAR-100 and ImageNet (ILSVRC) datasets by incorporating the pseudo label with various existing supervised approaches and show promising results in unsupervised scenario.
Submission history
From: Jiangpeng He [view email][v1] Wed, 14 Apr 2021 23:46:17 GMT (5059kb,D)
[v2] Wed, 21 Apr 2021 22:53:32 GMT (5059kb,D)
[v3] Fri, 30 Jul 2021 23:22:08 GMT (7227kb,D)
Link back to: arXiv, form interface, contact.