We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning

Abstract: Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on incremental object detection that rely on the availability of abundant training samples per novel class that substantially limits the scalability to real-world setting where novel data can be scarce. In this paper, we propose the Incremental-DETR that does incremental few-shot object detection via fine-tuning and self-supervised learning on the DETR object detector. To alleviate severe over-fitting with few novel class data, we first fine-tune the class-specific components of DETR with self-supervision from additional object proposals generated using Selective Search as pseudo labels. We further introduce a incremental few-shot fine-tuning strategy with knowledge distillation on the class-specific components of DETR to encourage the network in detecting novel classes without catastrophic forgetting. Extensive experiments conducted on standard incremental object detection and incremental few-shot object detection settings show that our approach significantly outperforms state-of-the-art methods by a large margin.
Comments: 11 pages, 2 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2205.04042 [cs.CV]
  (or arXiv:2205.04042v2 [cs.CV] for this version)

Submission history

From: Na Dong [view email]
[v1] Mon, 9 May 2022 05:08:08 GMT (772kb,D)
[v2] Thu, 19 May 2022 10:19:50 GMT (818kb,D)

Link back to: arXiv, form interface, contact.