Current browse context:
cs.SD
Change to browse by:
References & Citations
Computer Science > Sound
Title: Towards Multi-Scale Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis
(Submitted on 6 Apr 2022 (v1), last revised 5 Jul 2022 (this version, v2))
Abstract: Previous works on expressive speech synthesis focus on modelling the mono-scale style embedding from the current sentence or context, but the multi-scale nature of speaking style in human speech is neglected. In this paper, we propose a multi-scale speaking style modelling method to capture and predict multi-scale speaking style for improving the naturalness and expressiveness of synthetic speech. A multi-scale extractor is proposed to extract speaking style embeddings at three different levels from the ground-truth speech, and explicitly guide the training of a multi-scale style predictor based on hierarchical context information. Both objective and subjective evaluations on a Mandarin audiobooks dataset demonstrate that our proposed method can significantly improve the naturalness and expressiveness of the synthesized speech.
Submission history
From: Shun Lei [view email][v1] Wed, 6 Apr 2022 11:38:23 GMT (950kb,D)
[v2] Tue, 5 Jul 2022 05:01:08 GMT (951kb,D)
Link back to: arXiv, form interface, contact.