References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Iterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognition
(Submitted on 21 Jul 2021 (v1), last revised 17 Oct 2021 (this version, v2))
Abstract: When recognizing emotions, subtle nuances in displays of emotion generate ambiguity or uncertainty in emotion perception. Emotion uncertainty has been previously interpreted as inter-rater disagreement among multiple annotators. In this paper, we consider a more common and challenging scenario: modeling emotion uncertainty when only single emotion labels are available. From a Bayesian perspective, we propose to use deep ensembles to capture uncertainty for multiple emotion descriptors, i.e., action units, discrete expression labels and continuous descriptors. We further apply iterative self-distillation. Iterative distillation over multiple generations significantly improves performance in both emotion recognition and uncertainty estimation. Our method generates single student models that provide accurate estimates of uncertainty for in-domain samples and a student ensemble that can detect out-of-domain samples. Our experiments on emotion recognition and uncertainty estimation using the Aff-wild2 dataset demonstrate that our algorithm gives more reliable uncertainty estimates than both Temperature Scaling and Monte Carol Dropout.
Submission history
From: Didan Deng [view email][v1] Wed, 21 Jul 2021 09:49:16 GMT (1350kb,D)
[v2] Sun, 17 Oct 2021 12:20:18 GMT (1838kb,D)
Link back to: arXiv, form interface, contact.