Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Accidental Learners: Spoken Language Identification in Multilingual Self-Supervised Models
(Submitted on 9 Nov 2022 (v1), last revised 13 Mar 2023 (this version, v2))
Abstract: In this paper, we extend previous self-supervised approaches for language identification by experimenting with Conformer based architecture in a multilingual pre-training paradigm. We find that pre-trained speech models optimally encode language discriminatory information in lower layers. Further, we demonstrate that the embeddings obtained from these layers are significantly robust to classify unseen languages and different acoustic environments without additional training. After fine-tuning a pre-trained Conformer model on the VoxLingua107 dataset, we achieve results similar to current state-of-the-art systems for language identification. More, our model accomplishes this with 5x less parameters. We open-source the model through the NVIDIA NeMo toolkit.
Submission history
From: Travis Bartley [view email][v1] Wed, 9 Nov 2022 18:53:59 GMT (53kb)
[v2] Mon, 13 Mar 2023 13:35:10 GMT (54kb)
Link back to: arXiv, form interface, contact.