In music source separation, the number of sources may vary for each piece and some of the sources may belong to the same family of instruments, thus sharing timbral characteristics and making the sources more correlated. This leads to additional challenges in the source separation problem. This paper proposes a source separation method for multiple musical instruments sounding simultaneously and explores how much additional information apart from the audio stream can lift the quality of source separation. We explore conditioning techniques at different levels of a primary source separation network and utilize two extra modalities of data, namely presence or absence of instruments in the mixture, and the corresponding video stream data.
SLIZOVSKAIA Olga;
HARO Gloria;
GOMEZ GUTIERREZ Emilia;
2021-07-30
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
JRC125426
2329-9290 (online),
https://ieeexplore.ieee.org/document/9437620,
https://publications.jrc.ec.europa.eu/repository/handle/JRC125426,
10.1109/TASLP.2021.3082331 (online),
| Name | Country | City | Type |
|---|
This document is only visible at the Commission level.
You are not authorized to publish or distribute it outside the European Commission.
This is a public document. You can share this publication.
Datasets
| ID | Title | Public URL |
|---|
Dataset collections
| ID | Acronym | Title | Public URL |
|---|
Scripts / source codes
| Description | Public URL |
|---|
Additional supporting files
| File name | Description | File type |
|---|