References & Citations
Computer Science > Machine Learning
Title: Robust Contrastive Active Learning with Feature-guided Query Strategies
(Submitted on 13 Sep 2021 (v1), last revised 14 Aug 2022 (this version, v2))
Abstract: We introduce supervised contrastive active learning (SCAL) and propose efficient query strategies in active learning based on the feature similarity (featuresim) and principal component analysis based feature-reconstruction error (fre) to select informative data samples with diverse feature representations. We demonstrate our proposed method achieves state-of-the-art accuracy, model calibration and reduces sampling bias in an active learning setup for balanced and imbalanced datasets on image classification tasks. We also evaluate robustness of model to distributional shift derived from different query strategies in active learning setting. Using extensive experiments, we show that our proposed approach outperforms high performing compute-intensive methods by a big margin resulting in 9.9% lower mean corruption error, 7.2% lower expected calibration error under dataset shift and 8.9% higher AUROC for out-of-distribution detection.
Submission history
From: Ranganath Krishnan [view email][v1] Mon, 13 Sep 2021 21:09:21 GMT (13319kb,D)
[v2] Sun, 14 Aug 2022 19:39:03 GMT (15170kb,D)
Link back to: arXiv, form interface, contact.