We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Sound

Title: Streaming Multi-talker Speech Recognition with Joint Speaker Identification

Abstract: In multi-talker scenarios such as meetings and conversations, speech processing systems are usually required to transcribe the audio as well as identify the speakers for downstream applications. Since overlapped speech is common in this case, conventional approaches usually address this problem in a cascaded fashion that involves speech separation, speech recognition and speaker identification that are trained independently. In this paper, we propose Streaming Unmixing, Recognition and Identification Transducer (SURIT) -- a new framework that deals with this problem in an end-to-end streaming fashion. SURIT employs the recurrent neural network transducer (RNN-T) as the backbone for both speech recognition and speaker identification. We validate our idea on the LibrispeechMix dataset -- a multi-talker dataset derived from Librispeech, and present encouraging results.
Comments: 5 pages, 2 figures, submitted to Interspeech 2021
Subjects: Sound (cs.SD); Computation and Language (cs.CL)
Cite as: arXiv:2104.02109 [cs.SD]
  (or arXiv:2104.02109v1 [cs.SD] for this version)

Submission history

From: Liang Lu [view email]
[v1] Mon, 5 Apr 2021 18:37:33 GMT (109kb,D)

Link back to: arXiv, form interface, contact.