Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Adversarial Contrastive Predictive Coding for Unsupervised Learning of Disentangled Representations
(Submitted on 26 May 2020 (this version), latest version 11 Mar 2021 (v2))
Abstract: In this work we tackle disentanglement of speaker and content related variations in speech signals. We propose a fully convolutional variational autoencoder employing two encoders: a content encoder and a speaker encoder. To foster disentanglement we propose adversarial contrastive predictive coding. This new disentanglement method does neither need parallel data nor any supervision, not even speaker labels. With successful disentanglement the model is able to perform voice conversion by recombining content and speaker attributes. Due to the speaker encoder which learns to extract speaker traits from an audio signal, the proposed model not only provides meaningful speaker embeddings but is also able to perform zero-shot voice conversion, i.e. with previously unseen source and target speakers. Compared to state-of-the-art disentanglement approaches we show competitive disentanglement and voice conversion performance for speakers seen during training and superior performance for unseen speakers.
Submission history
From: Janek Ebbers [view email][v1] Tue, 26 May 2020 18:35:56 GMT (44kb)
[v2] Thu, 11 Mar 2021 09:52:39 GMT (31kb)
Link back to: arXiv, form interface, contact.