International Audio Laboratories Erlangen

Break-Informed Audio Decomposition for Interactive Redrumming

Accompanying website for "Break-Informed Audio Decomposition for Interactive Redrumming", presented at ISMIR 2018 as a late-breaking/demo contribution.

  1. Patricio López-Serrano, Matthew E. P. Davies, Jason Hockman, Christian Dittmar, and Meinard Müller
    Break-Informed Audio Decomposition For Interactive Redrumming
    In Late-Breaking and Demo Session of the International Conference on Music Information Retrieval (ISMIR), 2018. PDF Demo 
    @inproceedings{LopezSerranoDHDM18_ReDrum_ISMIR-LBD,
author = {Patricio L{\'o}pez-Serrano and Matthew E. P. Davies and Jason Hockman and Christian Dittmar and Meinard M{\"u}ller},
title = {Break-Informed Audio Decomposition For Interactive Redrumming},
booktitle = {Late-Breaking and Demo Session of the International Conference on Music Information Retrieval ({ISMIR})},
address = {Paris, France},
year = {2018},
url-pdf = {2018_LopezSerranoDHDM_Redrum_ISMIR-LBD.pdf},
url-demo={https://www.audiolabs-erlangen.de/resources/MIR/2018-ISMIR-LBD-Redrum},
}

Abstract

Redrumming or drum replacement is used to substitute or enhance the drum hits in a song with one-shot drum sounds obtained from an external collection or database. In an ideal setting, this is done on multitrack audio, where one or more tracks are dedicated exclusively to drums and percussion. However, most non-professional producers and DJs only have access to mono or stereo downmixes of the music they work with. Motivated by this scenario, as well as previous work on decomposition techniques for audio signals, we propose a step towards enabling full-fledged redrumming with mono downmixes.

Let there be drums
This figure shows an overview of our break-informed redrumming method. The left side contains the track that will be redrummed, separated into a harmonic part (horizontal orange bars) and three percussive parts (for kick, snare, and hi-hat). The right side contains the track that will provide the timbral information for the redrum, with sounds being "copied" onto appropriate timepoints in the left-hand track.

Example: Incredible Bongo Band - Apache [YouTube Link]

For these examples we have fixed "Apache" by the Incredible Bongo Band as the track to be redrummed, using different breaks as timbral sources. All tracks labeled as Redrum mix contain the harmonic information from "Apache", together with the corresponding redrum. All tracks labeled as Redrum percussion contain only the redrum percussion, facilitating comparison.

Acknowledgments

Patricio López-Serrano is supported in part by a scholarship from CONACYT-DAAD.

Matthew Davies is supported by national funds through the FCT - Foundation for Science and Technology, I.P., under the project IF/01566/2015. Project TEC4Growth - Pervasive Intelligence, Enhancers and Proofs of Concept with Industrial Impact/NORTE-01-0145-FEDER-000020, financed by the North Portugal Regional Operational Programme (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, and through the European Regional Development Fund (ERDF).

Christian Dittmar and Meinard Müller are supported by the German Research Foundation (DFG-MU 2686/10-1).

The International Audio Laboratories Erlangen are a joint institution of the Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) and Fraunhofer Institute for Integrated Circuits IIS.

CONACYT
CONACYT
DFG
foureyes
Investigador FCT
POPH
UE

Legal notice

The multimedia linked on this page are given for educational purposes only. If any legal problems occur, please contact us. Any content that allegedly infringes the copyright of a third party will be removed upon request by the copyright holder.