Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Weakly Supervised Construction of ASR Systems with Massive Video Data
(Submitted on 4 Aug 2020 (v1), last revised 19 Sep 2020 (this version, v2))
Abstract: Building Automatic Speech Recognition (ASR) systems from scratch is significantly challenging, mostly due to the time-consuming and financially-expensive process of annotating a large amount of audio data with transcripts. Although several unsupervised pre-training models have been proposed, applying such models directly might still be sub-optimal if more labeled, training data could be obtained without a large cost. In this paper, we present a weakly supervised framework for constructing ASR systems with massive video data. As videos often contain human-speech audios aligned with subtitles, we consider videos as an important knowledge source, and propose an effective approach to extract high-quality audios aligned with transcripts from videos based on Optical Character Recognition (OCR). The underlying ASR model can be fine-tuned to fit any domain-specific target training datasets after weakly supervised pre-training. Extensive experiments show that our framework can easily produce state-of-the-art results on six public datasets for Mandarin speech recognition.
Submission history
From: Chengyu Wang [view email][v1] Tue, 4 Aug 2020 03:11:32 GMT (367kb,D)
[v2] Sat, 19 Sep 2020 07:22:35 GMT (364kb,D)
Link back to: arXiv, form interface, contact.