We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Sound

Title: Many-Speakers Single Channel Speech Separation with Optimal Permutation Training

Abstract: Single channel speech separation has experienced great progress in the last few years. However, training neural speech separation for a large number of speakers (e.g., more than 10 speakers) is out of reach for the current methods, which rely on the Permutation Invariant Loss (PIT). In this work, we present a permutation invariant training that employs the Hungarian algorithm in order to train with an $O(C^3)$ time complexity, where $C$ is the number of speakers, in comparison to $O(C!)$ of PIT based methods. Furthermore, we present a modified architecture that can handle the increased number of speakers. Our approach separates up to $20$ speakers and improves the previous results for large $C$ by a wide margin.
Comments: Accepted to Interspeech 2021, Data creation link added
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
Cite as: arXiv:2104.08955 [cs.SD]
  (or arXiv:2104.08955v4 [cs.SD] for this version)

Submission history

From: Shaked Dovrat [view email]
[v1] Sun, 18 Apr 2021 20:56:12 GMT (2183kb,D)
[v2] Mon, 7 Jun 2021 18:42:04 GMT (2169kb,D)
[v3] Fri, 2 Jul 2021 10:57:33 GMT (2166kb,D)
[v4] Sun, 7 Nov 2021 07:06:25 GMT (2166kb,D)

Link back to: arXiv, form interface, contact.