Current browse context:
eess.AS
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation
(Submitted on 11 Mar 2021 (v1), last revised 21 Apr 2021 (this version, v2))
Abstract: Inspired by the recent progress in self-supervised learning for computer vision that generates supervision using data augmentations, we explore a new general-purpose audio representation learning approach. We propose learning general-purpose audio representation from a single audio segment without expecting relationships between different time segments of audio samples. To implement this principle, we introduce Bootstrap Your Own Latent (BYOL) for Audio (BYOL-A, pronounced "viola"), an audio self-supervised learning method based on BYOL for learning general-purpose audio representation. Unlike most previous audio self-supervised learning methods that rely on agreement of vicinity audio segments or disagreement of remote ones, BYOL-A creates contrasts in an augmented audio segment pair derived from a single audio segment. With a combination of normalization and augmentation techniques, BYOL-A achieves state-of-the-art results in various downstream tasks. Extensive ablation studies also clarified the contribution of each component and their combinations.
Submission history
From: Daisuke Niizumi [view email][v1] Thu, 11 Mar 2021 14:32:33 GMT (530kb,D)
[v2] Wed, 21 Apr 2021 01:06:44 GMT (531kb,D)
Link back to: arXiv, form interface, contact.