Singing-Voice Separation From Monaural Recordings
Using Robust Principal Component Analysis (ICASSP 2012)
Po-Sen Huang, Scott Deeann Chen, Paris Smaragdis, Mark Hasegawa-Johnson
Abstract
Separating singing voices from music accompaniment is an important task in many applications, such as music information retrieval, lyric recognition and alignment. Music accompaniment can be assumed to be in a low-rank subspace, because of its repetition structure; on the other hand, singing voices can be regarded as relatively sparse within songs. In this paper, based on this assumption, we propose using robust principal component analysis for singing-voice separation from music accompaniment. Moreover, we examine the separation result by using a binary time-frequency masking method. Evaluations on the MIR-1K dataset show that this method can achieve around 1∼1.4 dB higher GNSDR compared with two state-of-the-art approaches without using prior training or requiring particular features.
Description
This package contains the Matlab codes implementing the RPCA source separation algorithm described in
"Singing-Voice Separation From Monaural Recordings Using Robust Principal Component Analysis," ICASSP 2012.
Our algorithm is composed of the following parts:
a. STFT, masking
b. Robust Principal Component solved by using inexact augmented Lagrange multiplier (ALM) Method
Reference: http://perception.csl.uiuc.edu/matrix-rank/sample_code.html
c. ISTFT
d. BSS Eval toolbox Version 2.1
Reference: http://bass-db.gforge.inria.fr/bss_eval/
The algorithm achieves the state-of-the-art performance on MIR-1K Dataset in an unsupervised way.
Reference: https://sites.google.com/site/unvoicedsoundseparation/mir-1k
( Mix signals with different SNR values: http://labrosa.ee.columbia.edu/projects/renoiser/ )
Run rpca_mask_run.m to see how the functions are called.
Demo
Separation examples (from MIR-1K Dataset)
Application to lyric synchronization
Download
Related work
Deep learning for monaural source separation
Feedback
Email me if you have any questions.