Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Lattice-Free Sequence Discriminative Training for Phoneme-Based Neural Transducers
(Submitted on 7 Dec 2022 (v1), last revised 25 May 2023 (this version, v3))
Abstract: Recently, RNN-Transducers have achieved remarkable results on various automatic speech recognition tasks. However, lattice-free sequence discriminative training methods, which obtain superior performance in hybrid models, are rarely investigated in RNN-Transducers. In this work, we propose three lattice-free training objectives, namely lattice-free maximum mutual information, lattice-free segment-level minimum Bayes risk, and lattice-free minimum Bayes risk, which are used for the final posterior output of the phoneme-based neural transducer with a limited context dependency. Compared to criteria using N-best lists, lattice-free methods eliminate the decoding step for hypotheses generation during training, which leads to more efficient training. Experimental results show that lattice-free methods gain up to 6.5% relative improvement in word error rate compared to a sequence-level cross-entropy trained model. Compared to the N-best-list based minimum Bayes risk objectives, lattice-free methods gain 40% - 70% relative training time speedup with a small degradation in performance.
Submission history
From: Zijian Yang [view email][v1] Wed, 7 Dec 2022 12:49:10 GMT (52kb)
[v2] Mon, 30 Jan 2023 22:32:53 GMT (28kb)
[v3] Thu, 25 May 2023 15:54:35 GMT (28kb)
Link back to: arXiv, form interface, contact.