We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Teaching CNNs to mimic Human Visual Cognitive Process & regularise Texture-Shape bias

Abstract: Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects using shape. It is believed that the cost function forces the CNN to take a greedy approach and develop a proclivity for local information like texture to increase accuracy, thus failing to explore any global statistics. We propose CognitiveCNN, a new intuitive architecture, inspired from feature integration theory in psychology to utilise human interpretable feature like shape, texture, edges etc. to reconstruct, and classify the image. We define novel metrics to quantify the "relevance" of "abstract information" present in these modalities using attention maps. We further introduce a regularisation method which ensures that each modality like shape, texture etc. gets proportionate influence in a given task, as it does for reconstruction; and perform experiments to show the resulting boost in accuracy and robustness, besides imparting explainability to these CNNs for achieving superior performance in object recognition.
Comments: Submitted at ICASSP 2022; 5 Pages; LaTex;
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
Journal reference: 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
DOI: 10.1109/ICASSP43922.2022.9747796
Report number: INSPEC Accession Number: 21906599
Cite as: arXiv:2006.14722 [cs.CV]
  (or arXiv:2006.14722v2 [cs.CV] for this version)

Submission history

From: Satyam Mohla Mr. [view email]
[v1] Thu, 25 Jun 2020 22:32:54 GMT (1609kb,D)
[v2] Mon, 10 Jan 2022 00:43:26 GMT (1278kb,D)

Link back to: arXiv, form interface, contact.