Current browse context:
eess
Change to browse by:
References & Citations
Computer Science > Sound
Title: StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesis
(Submitted on 7 Oct 2021 (v1), last revised 8 Oct 2021 (this version, v2))
Abstract: Recently, emotional speech synthesis has achieved remarkable performance. The emotion strength of synthesized speech can be controlled flexibly using a strength descriptor, which is obtained by an emotion attribute ranking function. However, a trained ranking function on specific data has poor generalization, which limits its applicability for more realistic cases. In this paper, we propose a deep learning based emotion strength assessment network for strength prediction that is referred to as StrengthNet. Our model conforms to a multi-task learning framework with a structure that includes an acoustic encoder, a strength predictor and an auxiliary emotion predictor. A data augmentation strategy was utilized to improve the model generalization. Experiments show that the predicted emotion strength of the proposed StrengthNet are highly correlated with ground truth scores for seen and unseen speech. Our codes are available at: this https URL
Submission history
From: Rui Liu [view email][v1] Thu, 7 Oct 2021 03:16:15 GMT (1238kb,D)
[v2] Fri, 8 Oct 2021 03:28:23 GMT (1238kb,D)
Link back to: arXiv, form interface, contact.