Current browse context:
cs.SD
Change to browse by:
References & Citations
Computer Science > Sound
Title: SpecSinGAN: Sound Effect Variation Synthesis Using Single-Image GANs
(Submitted on 14 Oct 2021 (v1), last revised 5 Apr 2022 (this version, v2))
Abstract: Single-image generative adversarial networks learn from the internal distribution of a single training example to generate variations of it, removing the need of a large dataset. In this paper we introduce SpecSinGAN, an unconditional generative architecture that takes a single one-shot sound effect (e.g., a footstep; a character jump) and produces novel variations of it, as if they were different takes from the same recording session. We explore the use of multi-channel spectrograms to train the model on the various layers that comprise a single sound effect. A listening study comparing our model to real recordings and to digital signal processing procedural audio models in terms of sound plausibility and variation revealed that SpecSinGAN is more plausible and varied than the procedural audio models considered, when using multi-channel spectrograms. Sound examples can be found at the project website: this https URL
Submission history
From: Adrián Barahona-Ríos [view email][v1] Thu, 14 Oct 2021 12:25:52 GMT (129kb,D)
[v2] Tue, 5 Apr 2022 09:23:09 GMT (2702kb,D)
Link back to: arXiv, form interface, contact.