Current browse context:
cs.SD
Change to browse by:
References & Citations
Computer Science > Sound
Title: DECAR: Deep Clustering for learning general-purpose Audio Representations
(Submitted on 17 Oct 2021 (v1), last revised 14 Mar 2023 (this version, v4))
Abstract: We introduce DECAR, a self-supervised pre-training approach for learning general-purpose audio representations. Our system is based on clustering: it utilizes an offline clustering step to provide target labels that act as pseudo-labels for solving a prediction task. We develop on top of recent advances in self-supervised learning for computer vision and design a lightweight, easy-to-use self-supervised pre-training scheme. We pre-train DECAR embeddings on a balanced subset of the large-scale Audioset dataset and transfer those representations to 9 downstream classification tasks, including speech, music, animal sounds, and acoustic scenes. Furthermore, we conduct ablation studies identifying key design choices and also make all our code and pre-trained models publicly available.
Submission history
From: Sreyan Ghosh [view email][v1] Sun, 17 Oct 2021 19:03:51 GMT (1287kb,D)
[v2] Sat, 6 Nov 2021 19:19:20 GMT (18861kb,D)
[v3] Mon, 4 Apr 2022 14:22:18 GMT (3144kb,D)
[v4] Tue, 14 Mar 2023 14:29:58 GMT (18862kb,D)
Link back to: arXiv, form interface, contact.