References & Citations
Electrical Engineering and Systems Science > Audio and Speech Processing
Title: Feature-informed Latent Space Regularization for Music Source Separation
(Submitted on 17 Mar 2022 (v1), last revised 27 Jun 2022 (this version, v2))
Abstract: The integration of additional side information to improve music source separation has been investigated numerous times, e.g., by adding features to the input or by adding learning targets in a multi-task learning scenario. These approaches, however, require additional annotations such as musical scores, instrument labels, etc. in training and possibly during inference. The available datasets for source separation do not usually provide these additional annotations. In this work, we explore transfer learning strategies to incorporate VGGish features with a state-of-the-art source separation model; VGGish features are known to be a very condensed representation of audio content and have been successfully used in many MIR tasks. We introduce three approaches to incorporate the features, including two latent space regularization methods and one naive concatenation method. Experimental results show that our proposed approaches improve several evaluation metrics for music source separation.
Submission history
From: Yun-Ning Hung [view email][v1] Thu, 17 Mar 2022 07:18:09 GMT (3307kb,D)
[v2] Mon, 27 Jun 2022 16:44:50 GMT (6434kb,D)
Link back to: arXiv, form interface, contact.