International Audio Laboratories Erlangen

Unifying Local and Global Methods for Harmonic-Percussive Source Separation

[Back to Main Page]

Wynton Marsalis - Caravan This excerpt is taken from the 1986 recording of a well-known jazz standard. The intro section lasts from 0:00 to 0:15 and features Jeff Watts on drums, Marcus Roberts on piano and Robert Leslie Hurst playing the bass. In comparison to KAM and Median-Filtering, our method delivers more natural sounding kick and snare sounds. It has problems to capture the ride cymbal and the toms. Both ride and toms can be preserved in the oracle case, when score-informed hard constraints are applied to the NMF activations.

Direct comparison of percussive estimates

Direct comparison of harmonic estimates

Oracle: KAM + NMF + Score-Informed Initialization [1,2]

Proposed: KAM + NMF [1]

KAM-based HPSS [3,4]

Median-Filtering HPSS [5]

Constrained NMF [6]

Legal notice

The audio examples used on this page are given for educational purposes only. If any legal problems occur, please contact us. Any content that allegedly infringes the copyright of a third party will be removed upon request by the copyright holder.

References

1. Christian Dittmar, Patricio López-Serrano, and and Meinard Müller
   Unifying Local and Global Methods for Harmonic-Percussive Source Separation
   In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2018. Bibtex

   @inproceedings{DittmarLM18_HPSS_KAM_NMF_ICASSP,
   author    = {Christian Dittmar and Patricio L{\'o}pez-Serrano and and Meinard M{\"u}ller},
   title     = {Unifying Local and Global Methods for Harmonic-Percussive Source Separation},
   booktitle = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
   address   = {Calgary, Canada},
   month     = {April},
   note      = {accepted for publication},
   year      = {2018},
   }

2. Sebastian Ewert, Bryan Pardo, Meinard Müller, and Mark Plumbley
   Score-Informed Source Separation for Musical Audio Recordings: An overview
   IEEE Signal Processing Magazine, 31(3): 116–124, 2014. Bibtex PDF

   @article{EwertPMP14_SourceSeparation_IEEE-SPS,
   author    = {Sebastian Ewert and Bryan Pardo and Meinard M{\"u}ller and Mark Plumbley},
   title     = {Score-Informed Source Separation for Musical Audio Recordings: An overview},
   journal   = {IEEE Signal Processing Magazine},
   volume    = {31},
   number    = {3},
   year      = {2014},
   month     = {April},
   pages     = {116--124},
   url-pdf   = {http://ieeexplore.ieee.org/document/6784086/},
   }

3. Derry FitzGerald, Antoine Liutkus, Zafar Rafii, Bryan Pardo, and Laurent Daudet
   Harmonic/Percussive Separation Using Kernel Additive Modelling
   In Irish Signals and Systems Conference (IET): 35–40, 2014. Bibtex PDF

   @inproceedings{FitzgeraldLRPD14_KAMHP_IET,
   title     = {Harmonic/Percussive Separation Using {K}ernel {A}dditive {M}odelling},
   author    = {Derry FitzGerald and Antoine Liutkus and  Zafar Rafii and Bryan Pardo and Laurent Daudet},
   booktitle = {Irish Signals and Systems Conference ({IET})},
   pages     = {35--40},
   address   = {Limerick, Ireland},
   year      = {2014},
   url-pdf   = {http://ieeexplore.ieee.org/document/6912726/},
   }

4. Christian Dittmar, Jonathan Driedger, Meinard Müller, and Jouni Paulus
   An Experimental Approach to Generalized Wiener Filtering in Music Source Separation
   In Proceedings of the European Signal Processing Conference (EUSIPCO), 2016. Bibtex PDF

   @inproceedings{DittmarDMP16_WienerFiltering_EUSIPCO,
   author    = {Christian Dittmar and Jonathan Driedger and Meinard M{\"u}ller and Jouni Paulus},
   title     = {An Experimental Approach to Generalized Wiener Filtering in Music Source Separation},
   booktitle = {Proceedings of the European Signal Processing Conference ({EUSIPCO})},
   address   = {Budapest, Hungary},
   year      = {2016},
   pages     = {},
   url-pdf   = {http://ieeexplore.ieee.org/document/7760547/},
   }

5. Derry FitzGerald
   Harmonic/Percussive Separation Using Median Filtering
   In Proceedings of the International Conference on Digital Audio Effects (DAFx): 246–253, 2010. Bibtex PDF

   @inproceedings{Fitzgerald10_HarmPercSep_DAFX,
   author      = {Derry FitzGerald},
   title       = {Harmonic/Percussive Separation Using Median Filtering},
   booktitle   = {Proceedings of the International Conference on Digital Audio Effects ({DAFx})},
   address     = {Graz, Austria},
   year        = {2010},
   pages       = {246--253},
   url-pdf     = {http://dafx10.iem.at/papers/DerryFitzGerald_DAFx10_P15.pdf},
   }

6. Jeongsoo Park, Jaeyoung Shin, and Kyogu Lee
   Exploiting Continuity/Discontinuity of Basis Vectors in Spectrogram Decomposition for Harmonic-Percussive Sound Separation
   IEEE/ACM Transactions on Audio, Speech, and Language Processing, 25(5): 1061–1074, 2017. Bibtex PDF

   @Article{ParkSL17_HPSS_NMF_IEEE-TASLP,
   author={Jeongsoo Park and Jaeyoung Shin and Kyogu Lee},
   journal={{IEEE/ACM} Transactions on Audio, Speech, and Language Processing},
   title={Exploiting Continuity/Discontinuity of Basis Vectors in Spectrogram Decomposition for Harmonic-Percussive Sound Separation},
   year={2017},
   volume={25},
   number={5},
   pages={1061--1074},
   month={May},
   url-pdf = {http://ieeexplore.ieee.org/document/7876808/},
   }

7. Antoine Liutkus and Roland Badeau
   Generalized Wiener filtering with fractional power spectrograms
   In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP): 266–270, 2015. Bibtex PDF

   @inproceedings{LiutkusB15_WienerFilter_ICASSP,
   author = {Antoine Liutkus and Roland Badeau},
   booktitle = {Proceedings of the {IEEE} International Conference on Acoustics, Speech and Signal Processing ({ICASSP})},
   title = {Generalized Wiener filtering with fractional power spectrograms},
   year = {2015},
   month = {April},
   pages = {266--270},
   address = {Brisbane, Australia},
   url-pdf = {http://ieeexplore.ieee.org/document/7177973/},
   }