We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.AS

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Audio and Speech Processing

Title: A Teacher-Student approach for extracting informative speaker embeddings from speech mixtures

Abstract: We introduce a monaural neural speaker embeddings extractor that computes an embedding for each speaker present in a speech mixture. To allow for supervised training, a teacher-student approach is employed: the teacher computes the target embeddings from each speaker's utterance before the utterances are added to form the mixture, and the student embedding extractor is then tasked to reproduce those embeddings from the speech mixture at its input. The system much more reliably verifies the presence or absence of a given speaker in a mixture than a conventional speaker embedding extractor, and even exhibits comparable performance to a multi-channel approach that exploits spatial information for embedding extraction. Further, it is shown that a speaker embedding computed from a mixture can be used to check for the presence of that speaker in another mixture.
Comments: Proceedings of INTERSPEECH
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
DOI: 10.21437/Interspeech.2023-1379
Cite as: arXiv:2306.00634 [eess.AS]
  (or arXiv:2306.00634v2 [eess.AS] for this version)

Submission history

From: Tobias Cord-Landwehr [view email]
[v1] Thu, 1 Jun 2023 12:59:04 GMT (975kb,D)
[v2] Tue, 19 Sep 2023 14:34:29 GMT (975kb,D)

Link back to: arXiv, form interface, contact.