We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.AS

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Audio and Speech Processing

Title: Magnitude-aware Probabilistic Speaker Embeddings

Abstract: Recently, hyperspherical embeddings have established themselves as a dominant technique for face and voice recognition. Specifically, Euclidean space vector embeddings are learned to encode person-specific information in their direction while ignoring the magnitude. However, recent studies have shown that the magnitudes of the embeddings extracted by deep neural networks may indicate the quality of the corresponding inputs. This paper explores the properties of the magnitudes of the embeddings related to quality assessment and out-of-distribution detection. We propose a new probabilistic speaker embedding extractor using the information encoded in the embedding magnitude and leverage it in the speaker verification pipeline. We also propose several quality-aware diarization methods and incorporate the magnitudes in those. Our results indicate significant improvements over magnitude-agnostic baselines both in speaker verification and diarization tasks.
Comments: Accepted to Odyssey 2022: The Speaker and Language Recognition Workshop, camera-ready version
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
DOI: 10.21437/Odyssey.2022-1
Cite as: arXiv:2202.13826 [eess.AS]
  (or arXiv:2202.13826v3 [eess.AS] for this version)

Submission history

From: Alexey Sholokhov [view email]
[v1] Mon, 28 Feb 2022 14:34:38 GMT (1993kb)
[v2] Sat, 7 May 2022 11:12:49 GMT (1111kb)
[v3] Sun, 23 Oct 2022 14:05:39 GMT (1111kb)

Link back to: arXiv, form interface, contact.