International Audio Laboratories Erlangen

Workshop MIR 2018

Teaser_01_MusicRepr Teaser_02_FourierTr Teaser_05_ChordReco Teaser_05_ScaleWalkuere Teaser_03_MusicSync3 Teaser_03_Interface2


Logo_HfM-Karlsruhe2

This is an invited workshop on Music Information Retrieval organized by the Hochschule für Musik Karlsruhe.

Content

Music signals possess specific acoustic and structural characteristics that are not shared by spoken language or audio signals from other domains. In fact, many music analysis tasks only become feasible by exploiting suitable music-specific assumptions. In this course, we study feature design principles that have been applied to music signals to account for the music-specific aspects. In particular, we discuss various musically expressive feature representations that refer to musical dimensions such as harmony, rhythm, timbre, or melody. Furthermore, we highlight the practical and musical relevance of these feature representations in the context of current music analysis and retrieval tasks. Here, our general goal is to show how the development of music-specific signal processing techniques is of fundamental importance for tackling otherwise infeasible music analysis problems.

The following video gives a brief impression about this course.

Playing back this video will transmit data to the service provider. To activate the video player, please press the button below.

Accompanying Textbook

Cover_Mueller_FMP_small

Meinard Müller
Fundamentals of Music Processing
Audio, Analysis, Algorithms, Applications
ISBN: 978-3-319-21944-8
Springer, 2015

Topics

  • Introduction
    Slides (PDF), Handouts (6 slides per page) (PDF)
  • Music Representations
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Chapter 1
  • Audio Features (Fourier Transform, Spectrogram, Pitch, Chroma)
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Section 2.1, Section 3.1
  • Harmony Analysis (Chord Recognition, Local Key Detection, HMMs)
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Chapter 5
  • Music Synchronization (Dynamic Time Warping)
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Section 3.2, Section 3.3
  • Classification and Clustering
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Chapter 7

Programming Exercises

Further Literature and Links

  1. Christof Weiß, Rainer Kleinertz, and Meinard Müller
    Möglichkeiten der computergestützten Erkennung und Visualisierung harmonischer Strukturen — eine Fallstudie zu Richard Wagners Die Walküre''
    In Bericht zur Jahrestagung der Gesellschaft für Musikforschung (GfM) 2015 in Halle/Saale, 2016. PDF 
    @inproceedings{WeissKM16_Wagner_GfM,
author    = {Christof Wei{\ss} and Rainer Kleinertz and Meinard M{\"u}ller},
title     = {{M}{\"o}glichkeiten der computergest{\"u}tzten {E}rkennung und {V}isualisierung harmonischer {S}trukturen -- eine {F}allstudie zu {R}ichard {W}agners ``{D}ie {W}alk{\"u}re''},
booktitle = {{B}ericht zur {J}ahrestagung der {G}esellschaft f{\"u}r {M}usikforschung ({GfM}) 2015 in Halle/Saale},
editor    = {Wolfgang Auhagen and Wolfgang Hirschmann},
publisher = {{S}chott {C}ampus},
address   = {Mainz, Germany},
year      = {2016},
url-pdf   = {2016_WeissKM_HarmStrukturWalkuere_SchottCampus.pdf}
}
  2. Christof Weiß, Vlora Arifi-Müller, Thomas Prätzlich, Rainer Kleinertz, and Meinard Müller
    Analyzing Measure Annotations for Western Classical Music Recordings
    In Proceedings of the International Conference on Music Information Retrieval (ISMIR): 517–523, 2016. PDF 
    @inproceedings{WeissAPKM16_Measure_ISMIR,
author    = {Christof Wei{\ss} and Vlora Arifi-M{\"u}ller and Thomas Pr{\"a}tzlich and Rainer Kleinertz and Meinard M{\"u}ller},
title     = {Analyzing Measure Annotations for Western Classical Music Recordings},
booktitle = {Proceedings of the International Conference on Music Information Retrieval ({ISMIR})},
address   = {New York, USA},
year      = {2016},
pages     = {517--523},
url-pdf   = {2016_WeissAPKM_MeasureAnnotation_ISMIR_ePrint.pdf}
}
  3. Thomas Prätzlich, Jonathan Driedger, and Meinard Müller
    Memory-Restricted Multiscale Dynamic Time Warping
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 569–573, 2016. PDF 
    @inproceedings{PraetzlichDM16_MsDTW_ICASSP,
author    = {Thomas Pr{\"a}tzlich and Jonathan Driedger and Meinard M{\"u}ller},
title     = {Memory-Restricted Multiscale Dynamic Time Warping},
booktitle = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address   = {Shanghai, China},
year      = {2016},
pages     = {569--573},
url-pdf   = {2016_PraetzlichDriedgerMueller_MrMsDTW_ICASSP.pdf}
}
  4. Meinard Müller
    Fundamentals of Music Processing — Audio, Analysis, Algorithms, Applications
    Springer Verlag, ISBN: 978-3-319-21944-8, 2015. Details 
    @book{Mueller15_FundamentalsMusicProcessig_SPRINGER,
author    = {Meinard M\"{u}ller},
title     = {Fundamentals of Music Processing -- Audio, Analysis, Algorithms, Applications},
type      = {Monograph},
year      = {2015},
isbn      = {978-3-319-21944-8},
publisher = {Springer Verlag},
url-details={http://www.music-processing.de}
}
  5. Daniel Röwenstrunk, Thomas Prätzlich, Thomas Betzwieser, Meinard Müller, Gerd Szwillus, and Joachim Veit
    Das Gesamtkunstwerk Oper aus Datensicht — Aspekte des Umgangs mit einer heterogenen Datenlage im BMBF-Projekt Freischütz Digital''
    Datenbank-Spektrum, 15(1): 65–72, 2015. PDF Details DOI 
    @article{RoewenstrunkPBMSV15_WeberOper_DBSK,
author    = {Daniel R{\"o}wenstrunk and Thomas Pr{\"a}tzlich and Thomas Betzwieser and Meinard M{\"u}ller and Gerd Szwillus and Joachim Veit},
title     = {{D}as {G}esamtkunstwerk {O}per aus {D}atensicht -- {A}spekte des {U}mgangs mit einer heterogenen {D}atenlage im {BMBF}-{P}rojekt ``{F}reisch{\"u}tz {D}igital''},
journal   = {Datenbank-Spektrum},
volume    = {15},
number    = {1},
pages     = {65--72},
year      = {2015},
doi       = {10.1007/s13222-015-0179-0},
url-pdf   = {2015_RoewenstrunkPBMSV_FreiDi_DatenbankSpektrum.pdf},
url-details = {http://freischuetz-digital.de/}
}
  6. Stefan Balke, Sanu Pulimootil Achankunju, and Meinard Müller
    Matching Musical Themes based on Noisy OCR and OMR Input
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 703–707, 2015. PDF 
    @inproceedings{BalkePM15_MatchingMusicalThemes_ICASSP,
author    = {Stefan Balke and Sanu Pulimootil Achankunju and Meinard M{\"u}ller},
title     = {Matching Musical Themes based on Noisy {OCR} and {OMR} Input},
booktitle  = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address  = {Brisbane, Australia},
year       = {2015},
pages    = {703--707},
url-pdf   = {2015_BalkePulimootilMueller_MusicRetrieval_ICASSP.pdf}
}
  7. Christof Weiss and Meinard Müller
    Tonal Complexity Features for Style Classification of Classical Music
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 688–692, 2015. PDF 
    @inproceedings{WeissM15_TonalComplexity_ICASSP,
author    = {Christof Weiss and Meinard M{\"u}ller},
title     = {Tonal Complexity Features for Style Classification of Classical Music},
booktitle  = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address  = {Brisbane, Australia},
year       = {2015},
pages    = {688--692},
url-pdf   = {2015_WeissMueller_TonalComplexity_ICASSP.pdf}
}
  8. Verena Konz and Meinard Müller
    A Cross-Version Approach for Harmonic Analysis of Music Recordings
    In Meinard Müller and Masataka Goto and Markus Schedl (ed.): Multimodal Music Processing, Schloss Dagstuhl—Leibniz-Zentrum für Informatik, 3: 53–72, 2012. PDF 
    @InCollection{KonzM12_CrossVersionHarmonicAnalysis_DagstuhlFU,
author  = {Verena Konz and Meinard M{\"u}ller},
title   = {A Cross-Version Approach for Harmonic Analysis of Music Recordings},
booktitle = {Multimodal Music Processing},
series  = {Dagstuhl Follow-Ups},
pages   = {53--72},
year        = {2012},
volume  = {3},
editor  = {Meinard M{\"u}ller and Masataka Goto and Markus Schedl},
publisher = {Schloss Dagstuhl--Leibniz-Zentrum f\"ur Informatik},
address     = {Dagstuhl, Germany},
url-pdf   = {2012_KonzMueller_CrossVersionHarmonicAnalysis_DagstuhlFU.pdf}
}
  9. Meinard Müller and Masataka Goto and Markus Schedl (ed.)
    Multimodal Music Processing
    In Dagstuhl Follow-Ups, Schloss Dagstuhl - Leibniz-Zentrum für Informatik, Germany, 3, 2012. PDF 
    @proceedings{MuellerGS12_MultimodalMusicProcessing_DagstuhlFU,
editor    = {Meinard M{\"u}ller and Masataka Goto and Markus Schedl},
title     = {Multimodal Music Processing},
booktitle = {Multimodal Music Processing},
publisher = {Schloss Dagstuhl - Leibniz-Zentrum f{\"u}r Informatik, Germany},
series    = {Dagstuhl Follow-Ups},
volume    = {3},
year      = {2012},
isbn      = {978-3-939897-37-8},
url-pdf={http://drops.dagstuhl.de/opus/volltexte/2011/3145/pdf/dagrep_v001_i001_p068_s11041.pdf}
}