References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image
(Submitted on 1 Dec 2021 (v1), last revised 24 Jan 2023 (this version, v4))
Abstract: What can neural networks learn about the visual world when provided with only a single image as input? While any image obviously cannot contain the multitudes of all existing objects, scenes and lighting conditions - within the space of all 256^(3x224x224) possible 224-sized square images, it might still provide a strong prior for natural images. To analyze this `augmented image prior' hypothesis, we develop a simple framework for training neural networks from scratch using a single image and augmentations using knowledge distillation from a supervised pretrained teacher. With this, we find the answer to the above question to be: `surprisingly, a lot'. In quantitative terms, we find accuracies of 94%/74% on CIFAR-10/100, 69% on ImageNet, and by extending this method to video and audio, 51% on Kinetics-400 and 84% on SpeechCommands. In extensive analyses spanning 13 datasets, we disentangle the effect of augmentations, choice of data and network architectures and also provide qualitative evaluations that include lucid `panda neurons' in networks that have never even seen one.
Submission history
From: Yuki Asano [view email][v1] Wed, 1 Dec 2021 18:59:54 GMT (30455kb,D)
[v2] Wed, 19 Jan 2022 12:54:40 GMT (20454kb,D)
[v3] Mon, 14 Mar 2022 08:06:35 GMT (8761kb,D)
[v4] Tue, 24 Jan 2023 16:17:47 GMT (29055kb,D)
Link back to: arXiv, form interface, contact.