Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: On Language Model Integration for RNN Transducer based Speech Recognition
(Submitted on 13 Oct 2021 (v1), last revised 16 Feb 2022 (this version, v2))
Abstract: The mismatch between an external language model (LM) and the implicitly learned internal LM (ILM) of RNN-Transducer (RNN-T) can limit the performance of LM integration such as simple shallow fusion. A Bayesian interpretation suggests to remove this sequence prior as ILM correction. In this work, we study various ILM correction-based LM integration methods formulated in a common RNN-T framework. We provide a decoding interpretation on two major reasons for performance improvement with ILM correction, which is further experimentally verified with detailed analysis. We also propose an exact-ILM training framework by extending the proof given in the hybrid autoregressive transducer, which enables a theoretical justification for other ILM approaches. Systematic comparison is conducted for both in-domain and cross-domain evaluation on the Librispeech and TED-LIUM Release 2 corpora, respectively. Our proposed exact-ILM training can further improve the best ILM method.
Submission history
From: Wei Zhou [view email][v1] Wed, 13 Oct 2021 16:30:46 GMT (19kb)
[v2] Wed, 16 Feb 2022 10:44:38 GMT (20kb)
Link back to: arXiv, form interface, contact.