Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: A Sneak Attack on Segmentation of Medical Images Using Deep Neural Network Classifiers
(Submitted on 8 Jan 2022 (v1), last revised 28 Jan 2022 (this version, v2))
Abstract: Instead of using current deep-learning segmentation models (like the UNet and variants), we approach the segmentation problem using trained Convolutional Neural Network (CNN) classifiers, which automatically extract important features from images for classification. Those extracted features can be visualized and formed into heatmaps using Gradient-weighted Class Activation Mapping (Grad-CAM). This study tested whether the heatmaps could be used to segment the classified targets. We also proposed an evaluation method for the heatmaps; that is, to re-train the CNN classifier using images filtered by heatmaps and examine its performance. We used the mean-Dice coefficient to evaluate segmentation results. Results from our experiments show that heatmaps can locate and segment partial tumor areas. But use of only the heatmaps from CNN classifiers may not be an optimal approach for segmentation. We have verified that the predictions of CNN classifiers mainly depend on tumor areas, and dark regions in Grad-CAM's heatmaps also contribute to classification.
Submission history
From: Shuyue Guan [view email][v1] Sat, 8 Jan 2022 05:57:26 GMT (8075kb,D)
[v2] Fri, 28 Jan 2022 04:47:31 GMT (8075kb,D)
Link back to: arXiv, form interface, contact.