Current browse context:
cs.LG
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: The phonetic bases of vocal expressed emotion: natural versus acted
(Submitted on 13 Nov 2019 (v1), last revised 25 Jul 2020 (this version, v3))
Abstract: Can vocal emotions be emulated? This question has been a recurrent concern of the speech community, and has also been vigorously investigated. It has been fueled further by its link to the issue of validity of acted emotion databases. Much of the speech and vocal emotion research has relied on acted emotion databases as valid proxies for studying natural emotions. To create models that generalize to natural settings, it is crucial to work with valid prototypes -- ones that can be assumed to reliably represent natural emotions. More concretely, it is important to study emulated emotions against natural emotions in terms of their physiological, and psychological concomitants. In this paper, we present an on-scale systematic study of the differences between natural and acted vocal emotions. We use a self-attention based emotion classification model to understand the phonetic bases of emotions by discovering the most 'attended' phonemes for each class of emotions. We then compare these attended-phonemes in their importance and distribution across acted and natural classes. Our tests show significant differences in the manner and choice of phonemes in acted and natural speech, concluding moderate to low validity and value in using acted speech databases for emotion classification tasks.
Submission history
From: Shahan Ali Memon [view email][v1] Wed, 13 Nov 2019 03:44:08 GMT (713kb,D)
[v2] Tue, 19 Nov 2019 20:49:50 GMT (713kb,D)
[v3] Sat, 25 Jul 2020 02:49:50 GMT (2464kb,D)
Link back to: arXiv, form interface, contact.