We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Audio and Speech Processing

Title: Pushing the Limits of Non-Autoregressive Speech Recognition

Abstract: We combine recent advancements in end-to-end speech recognition to non-autoregressive automatic speech recognition. We push the limits of non-autoregressive state-of-the-art results for multiple datasets: LibriSpeech, Fisher+Switchboard and Wall Street Journal. Key to our recipe, we leverage CTC on giant Conformer neural network architectures with SpecAugment and wav2vec2 pre-training. We achieve 1.8%/3.6% WER on LibriSpeech test/test-other sets, 5.1%/9.8% WER on Switchboard, and 3.4% on the Wall Street Journal, all without a language model.
Comments: Proceedings of INTERSPEECH
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
DOI: 10.21437/Interspeech.2021-337
Cite as: arXiv:2104.03416 [eess.AS]
  (or arXiv:2104.03416v4 [eess.AS] for this version)

Submission history

From: Edwin Ng [view email]
[v1] Wed, 7 Apr 2021 22:17:20 GMT (29kb)
[v2] Mon, 12 Apr 2021 15:09:29 GMT (28kb)
[v3] Wed, 16 Jun 2021 19:17:11 GMT (29kb)
[v4] Sat, 11 Sep 2021 19:08:13 GMT (29kb)

Link back to: arXiv, form interface, contact.