References & Citations
Computer Science > Machine Learning
Title: Applying the Decisiveness and Robustness Metrics to Convolutional Neural Networks
(Submitted on 29 May 2020)
Abstract: We review three recently-proposed classifier quality metrics and consider their suitability for large-scale classification challenges such as applying convolutional neural networks to the 1000-class ImageNet dataset. These metrics, referred to as the "geometric accuracy," "decisiveness," and "robustness," are based on the generalized mean ($\rho$ equals 0, 1, and -2/3, respectively) of the classifier's self-reported and measured probabilities of correct classification. We also propose some minor clarifications to standardize the metric definitions. With these updates, we show some examples of calculating the metrics using deep convolutional neural networks (AlexNet and DenseNet) acting on large datasets (the German Traffic Sign Recognition Benchmark and ImageNet).
Submission history
From: Christopher George [view email][v1] Fri, 29 May 2020 20:05:06 GMT (35kb,D)
Link back to: arXiv, form interface, contact.