Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition
(Submitted on 24 May 2022 (v1), last revised 18 Oct 2022 (this version, v3))
Abstract: The choice of modeling units is crucial for automatic speech recognition (ASR) tasks. In mandarin scenarios, the Chinese characters represent meaning but are not directly related to the pronunciation. Thus only considering the writing of Chinese characters as modeling units is insufficient to capture speech features. In this paper, we present a novel method involves with multi-level modeling units, which integrates multi-level information for mandarin speech recognition. Specifically, the encoder block considers syllables as modeling units and the decoder block deals with character-level modeling units. To facilitate the incremental conversion from syllable features to character features, we design an auxiliary task that applies cross-entropy (CE) loss to intermediate decoder layers. During inference, the input feature sequences are converted into syllable sequences by the encoder block and then converted into Chinese characters by the decoder block. Experiments on the widely used AISHELL-1 corpus demonstrate that our method achieves promising results with CER of 4.1%/4.6% and 4.6%/5.2%, using the Conformer and the Transformer backbones respectively.
Submission history
From: Yuting Yang [view email][v1] Tue, 24 May 2022 11:43:54 GMT (562kb,D)
[v2] Wed, 25 May 2022 02:36:27 GMT (566kb,D)
[v3] Tue, 18 Oct 2022 06:12:29 GMT (544kb,D)
Link back to: arXiv, form interface, contact.