We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Audio and Speech Processing

Title: Meta-Learning for Short Utterance Speaker Recognition with Imbalance Length Pairs

Abstract: In practical settings, a speaker recognition system needs to identify a speaker given a short utterance, while the enrollment utterance may be relatively long. However, existing speaker recognition models perform poorly with such short utterances. To solve this problem, we introduce a meta-learning framework for imbalance length pairs. Specifically, we use a Prototypical Networks and train it with a support set of long utterances and a query set of short utterances of varying lengths. Further, since optimizing only for the classes in the given episode may be insufficient for learning discriminative embeddings for unseen classes, we additionally enforce the model to classify both the support and the query set against the entire set of classes in the training set. By combining these two learning schemes, our model outperforms existing state-of-the-art speaker verification models learned with a standard supervised learning framework on short utterance (1-2 seconds) on the VoxCeleb datasets. We also validate our proposed model for unseen speaker identification, on which it also achieves significant performance gains over the existing approaches. The codes are available at this https URL
Comments: Accepted to Interspeech 2020. The codes are available at this https URL
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)
Cite as: arXiv:2004.02863 [eess.AS]
  (or arXiv:2004.02863v5 [eess.AS] for this version)

Submission history

From: SeongMin Kye [view email]
[v1] Mon, 6 Apr 2020 17:53:14 GMT (123kb,D)
[v2] Sat, 16 May 2020 06:55:10 GMT (124kb,D)
[v3] Tue, 19 May 2020 10:56:47 GMT (124kb,D)
[v4] Wed, 20 May 2020 04:07:46 GMT (124kb,D)
[v5] Tue, 11 Aug 2020 02:21:51 GMT (148kb,D)

Link back to: arXiv, form interface, contact.