We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Mask guided attention for fine-grained patchy image classification

Abstract: In this work, we present a novel mask guided attention (MGA) method for fine-grained patchy image classification. The key challenge of fine-grained patchy image classification lies in two folds, ultra-fine-grained inter-category variances among objects and very few data available for training. This motivates us to consider employing more useful supervision signal to train a discriminative model within limited training samples. Specifically, the proposed MGA integrates a pre-trained semantic segmentation model that produces auxiliary supervision signal, i.e., patchy attention mask, enabling a discriminative representation learning. The patchy attention mask drives the classifier to filter out the insignificant parts of images (e.g., common features between different categories), which enhances the robustness of MGA for the fine-grained patchy image classification. We verify the effectiveness of our method on three publicly available patchy image datasets. Experimental results demonstrate that our MGA method achieves superior performance on three datasets compared with the state-of-the-art methods. In addition, our ablation study shows that MGA improves the accuracy by 2.25% and 2% on the SoyCultivarVein and BtfPIS datasets, indicating its practicality towards solving the fine-grained patchy image classification.
Comments: 5 pages, two figures, 4 tables
Subjects: Computer Vision and Pattern Recognition (cs.CV)
ACM classes: I.4
Journal reference: 2021 IEEE International Conference on Image Processing (ICIP), 2021, pp. 1044-1048
DOI: 10.1109/ICIP42928.2021.9506424
Cite as: arXiv:2102.02771 [cs.CV]
  (or arXiv:2102.02771v1 [cs.CV] for this version)

Submission history

From: Jun Wang [view email]
[v1] Thu, 4 Feb 2021 17:54:50 GMT (357kb,D)
[v2] Wed, 22 Sep 2021 10:09:32 GMT (1754kb,D)

Link back to: arXiv, form interface, contact.