Current browse context:
cs.SD
Change to browse by:
References & Citations
Computer Science > Sound
Title: Multi-Source Diffusion Models for Simultaneous Music Generation and Separation
(Submitted on 4 Feb 2023 (v1), last revised 18 Mar 2024 (this version, v4))
Abstract: In this work, we define a diffusion-based generative model capable of both music synthesis and source separation by learning the score of the joint probability density of sources sharing a context. Alongside the classic total inference tasks (i.e., generating a mixture, separating the sources), we also introduce and experiment on the partial generation task of source imputation, where we generate a subset of the sources given the others (e.g., play a piano track that goes well with the drums). Additionally, we introduce a novel inference method for the separation task based on Dirac likelihood functions. We train our model on Slakh2100, a standard dataset for musical source separation, provide qualitative results in the generation settings, and showcase competitive quantitative results in the source separation setting. Our method is the first example of a single model that can handle both generation and separation tasks, thus representing a step toward general audio models.
Submission history
From: Emilian Postolache [view email][v1] Sat, 4 Feb 2023 23:18:36 GMT (221kb,D)
[v2] Tue, 7 Feb 2023 20:26:18 GMT (221kb,D)
[v3] Tue, 30 May 2023 15:21:55 GMT (203kb,D)
[v4] Mon, 18 Mar 2024 11:39:29 GMT (461kb,D)
Link back to: arXiv, form interface, contact.