References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Channel Importance Matters in Few-Shot Image Classification
(Submitted on 16 Jun 2022 (v1), last revised 20 Jun 2022 (this version, v2))
Abstract: Few-Shot Learning (FSL) requires vision models to quickly adapt to brand-new classification tasks with a shift in task distribution. Understanding the difficulties posed by this task distribution shift is central to FSL. In this paper, we show that a simple channel-wise feature transformation may be the key to unraveling this secret from a channel perspective. When facing novel few-shot tasks in the test-time datasets, this transformation can greatly improve the generalization ability of learned image representations, while being agnostic to the choice of training algorithms and datasets. Through an in-depth analysis of this transformation, we find that the difficulty of representation transfer in FSL stems from the severe channel bias problem of image representations: channels may have different importance in different tasks, while convolutional neural networks are likely to be insensitive, or respond incorrectly to such a shift. This points out a core problem of the generalization ability of modern vision systems and needs further attention in the future. Our code is available at this https URL
Submission history
From: Xu Luo [view email][v1] Thu, 16 Jun 2022 12:38:45 GMT (1088kb,D)
[v2] Mon, 20 Jun 2022 04:17:13 GMT (1089kb,D)
Link back to: arXiv, form interface, contact.