Using Score-Informed Constraints For NMF-Based Source Separation (ICASSP 2012)
This website is no longer being updated. Please visit http://www.audiolabs-erlangen.de/resources/MIR/ICASSP2012-ScoreInformedNMF/ to check for updates of this website.
ScoreConstrainedNMF

Using Score-Informed Constraints For NMF-Based Source Separation (ICASSP 2012)

Abstract: Techniques based on non-negative matrix factorization (NMF) can be used to efficiently decompose a magnitude spectrogram into a set of template (column) vectors and activation (row) vectors. To better control this decomposition, NMF has been extended using prior knowledge and parametric models. In this paper, we present such an extended approach that uses additional score information to guide the decomposition process. Here, opposed to previous methods, our main idea is to impose constraints on both the template as well as the activation side. We show that using such double constraints results in musically meaningful decompositions similar to parametric approaches, while being computationally less demanding and easier to implement. Furthermore, additional onset constraints can be incorporated in a straightforward manner without sacrificing robustness. We evaluate our approach in the context of separating note groups (e. g. the left or right hand) from monaural piano recordings.

Experimental Results

Real Audio
Synthetic Audio
Composer Piece Input MIDI
(Source)
Input Audio
(Source / Performer)
Separation
result
Input MIDI
(Source)
Input Audio
(Synthesizer)
Separation
result
Detailed
page
Bach BWV875-01 Mutopia [mid] SMD / 002 [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Chopin Op028-01 Mutopia [mid] SMD / 003 [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Chopin Op028-04 Mutopia [mid] SMD / 003 [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Chopin Op028-15 Mutopia [mid] SMD / 006 [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Chopin Op064No1 Mutopia [mid] European Archive / Lipatti [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Chopin Op066 Mutopia [mid] SMD / 006 [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Beethoven Op031No2-01 Mutopia [mid] SMD / 002 [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]
Beethoven Op111-01 Mutopia [mid] European Archive / Petri [mp3] [mp3] Mutopia [mid] Timidity [mp3] [mp3] [link]

Data Sources

Links