References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Consistent Relative Confidence and Label-Free Model Selection for Convolutional Neural Networks
(Submitted on 26 Aug 2021 (v1), last revised 31 May 2022 (this version, v9))
Abstract: In this paper, we are concerned with image classification with deep convolutional neural networks (CNNs). We focus on the following question: given a set of candidate CNN models, how to select the right one with the best generalization property for the current task? Current model selection methods all require access to a batch of labeled data for computing a pre-specified performance metric, such as the cross-entropy loss, the classification error rate and the negative log-likelihood. In many practical cases, labels are not available in time as labeling itself is a time-consuming and expensive task. To this end, we propose an approach to CNN model selection using only unlabeled data. We develop this method based on a principle termed consistent relative confidence. Experimental results on benchmark datasets demonstrate the effectiveness and efficiency of our method.
Submission history
From: Bin Liu [view email][v1] Thu, 26 Aug 2021 15:14:38 GMT (3731kb)
[v2] Mon, 24 Jan 2022 10:35:57 GMT (3008kb)
[v3] Wed, 26 Jan 2022 13:17:47 GMT (3008kb)
[v4] Thu, 27 Jan 2022 02:45:29 GMT (3008kb)
[v5] Fri, 28 Jan 2022 06:10:27 GMT (3008kb)
[v6] Mon, 31 Jan 2022 11:46:08 GMT (3008kb)
[v7] Thu, 28 Apr 2022 07:36:07 GMT (3063kb)
[v8] Sat, 28 May 2022 08:27:53 GMT (3063kb)
[v9] Tue, 31 May 2022 03:16:02 GMT (3008kb)
Link back to: arXiv, form interface, contact.