International Audio Laboratories Erlangen

Workshop MIR 2019

Teaser_01_MusicRepr Teaser_02_FourierTr Teaser_05_ChordReco Teaser_05_ScaleWalkuere Teaser_03_MusicSync3 Teaser_03_Interface2


Logo_HfM-Karlsruhe2

This is an invited workshop on Music Information Retrieval organized by the Hochschule für Musik Karlsruhe.

Content

Music signals possess specific acoustic and structural characteristics that are not shared by spoken language or audio signals from other domains. In fact, many music analysis tasks only become feasible by exploiting suitable music-specific assumptions. In this course, we study feature design principles that have been applied to music signals to account for the music-specific aspects. In particular, we discuss various musically expressive feature representations that refer to musical dimensions such as harmony, rhythm, timbre, or melody. Furthermore, we highlight the practical and musical relevance of these feature representations in the context of current music analysis and retrieval tasks. Here, our general goal is to show how the development of music-specific signal processing techniques is of fundamental importance for tackling otherwise infeasible music analysis problems.

The following videos give a brief impression about this course.

Playing back this video will transmit data to the service provider. To activate the video player, please press the button below.
Playing back this video will transmit data to the service provider. To activate the video player, please press the button below.

Accompanying Textbook

Cover_Mueller_FMP_small

Meinard Müller
Fundamentals of Music Processing
Audio, Analysis, Algorithms, Applications
ISBN: 978-3-319-21944-8
Springer, 2015

Topics (Preliminary Slides)

  • Introduction
    Slides (PDF), Handouts (6 slides per page) (PDF)
  • Music Representations
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Chapter 1
  • Audio Features (Fourier Transform, Spectrogram, Pitch, Chroma)
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Section 2.1, Section 3.1
  • Harmony Analysis (Chord Recognition, Local Key Detection, HMMs)
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Chapter 5
  • Music Synchronization (Dynamic Time Warping)
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Section 3.2, Section 3.3
  • Classification and Clustering
    Slides (PDF), Handouts (6 slides per page) (PDF)
    Literature: Chapter 7

Jupyter Notebooks

  • Installation (Environment, HTML, Notebook)
  • Short Time Fourier Transform & Chroma Features (HTML, ZIP)
  • Harmonic-Percussive Separation (HTML, ZIP)

Further Literature and Links

  1. Meinard Müller
    Fundamentals of Music Processing — Audio, Analysis, Algorithms, Applications
    Springer Verlag, ISBN: 978-3-319-21944-8, 2015. Details 
    @book{Mueller15_FundamentalsMusicProcessig_SPRINGER,
author    = {Meinard M\"{u}ller},
title     = {Fundamentals of Music Processing -- Audio, Analysis, Algorithms, Applications},
type      = {Monograph},
year      = {2015},
isbn      = {978-3-319-21944-8},
publisher = {Springer Verlag},
url-details={http://www.music-processing.de}
}
  2. Christof Weiß
    Computational Methods for Tonality-Based Style Analysis of Classical Music Audio Recordings
    PhD Thesis, Ilmenau University of Technology, 2017. PDF Presentation 
    @PhdThesis{Weiss17_StyleAnalysis_PhD,
author  = {Christof Wei{\ss}},
title   = {Computational Methods for Tonality-Based Style Analysis of Classical Music Audio Recordings},
school  = {Ilmenau University of Technology},
address = {Ilmenau, Germany},
year    = {2017},
url     = {http://www.db-thueringen.de/receive/dbt_mods_00032890},
url-pdf = {http://www.db-thueringen.de/servlets/MCRFileNodeServlet/dbt_derivate_00039054/ilm1-2017000293.pdf},
url-presentation = {https://www.audiolabs-erlangen.de/fau/assistant/weiss/publications/2017_Weiss_PhD-Defense_TUIlmenau.pdf}
}
  3. Frank Zalkow, Christof Weiß, and Meinard Müller
    Exploring Tonal-Dramatic Relationships in Richard Wagner 's Ring Cycle
    In Proceedings of the International Conference on Music Information Retrieval (ISMIR): 642–648, 2017. PDF 
    @inproceedings{ZalkowWM17_WagnerHarmony_ISMIR,
author    = {Frank Zalkow and Christof Wei{\ss} and Meinard M{\"u}ller},
title     = {Exploring Tonal-Dramatic Relationships in {R}ichard {W}agne{r\'s} {R}ing Cycle},
booktitle = {Proceedings of the International Conference on Music Information Retrieval ({ISMIR})},
pages     = {642--648},
address   = {Suzhou, China},
year      = {2017},
url-pdf   = {http://ismir2017.smcnus.org/wp-content/uploads/2017/10/132_Paper.pdf}
}
  4. Christof Weiß, Frank Zalkow, Meinard Müller, Stephanie Klauk, and Rainer Kleinertz
    Computergestützte Visualisierung Harmonischer Verläufe: Eine Fallstudie zu Wagners Ring
    In Proceedings of the Jahrestagung der Gesellschaft für Informatik (GI): 205–217, 2017. 
    @inproceedings{WeissZMKK_WagnerRing_GI,
author    = {Christof Wei{\ss} and Frank Zalkow and Meinard M{\"u}ller and Stephanie Klauk and Rainer Kleinertz},
title     = {{C}omputergest{\"u}tzte {V}isualisierung {H}armonischer {V}erl{\"a}ufe: {E}ine {F}allstudie zu {W}agners {R}ing},
booktitle = {Proceedings of the Jahrestagung der Gesellschaft f{\"{u}}r Informatik ({GI})},
pages     = {205--217},
address   = {Chemnitz, Germany},
year      = {2017}
}
  5. Christof Weiß, Rainer Kleinertz, and Meinard Müller
    Möglichkeiten der computergestützten Erkennung und Visualisierung harmonischer Strukturen — eine Fallstudie zu Richard Wagners Die Walküre''
    In Bericht zur Jahrestagung der Gesellschaft für Musikforschung (GfM) 2015 in Halle/Saale, 2016. PDF 
    @inproceedings{WeissKM16_Wagner_GfM,
author    = {Christof Wei{\ss} and Rainer Kleinertz and Meinard M{\"u}ller},
title     = {{M}{\"o}glichkeiten der computergest{\"u}tzten {E}rkennung und {V}isualisierung harmonischer {S}trukturen -- eine {F}allstudie zu {R}ichard {W}agners ``{D}ie {W}alk{\"u}re''},
booktitle = {{B}ericht zur {J}ahrestagung der {G}esellschaft f{\"u}r {M}usikforschung ({GfM}) 2015 in Halle/Saale},
editor    = {Wolfgang Auhagen and Wolfgang Hirschmann},
publisher = {{S}chott {C}ampus},
address   = {Mainz, Germany},
year      = {2016},
url-pdf   = {2016_WeissKM_HarmStrukturWalkuere_SchottCampus.pdf}
}
  6. Christof Weiß, Vlora Arifi-Müller, Thomas Prätzlich, Rainer Kleinertz, and Meinard Müller
    Analyzing Measure Annotations for Western Classical Music Recordings
    In Proceedings of the International Conference on Music Information Retrieval (ISMIR): 517–523, 2016. PDF 
    @inproceedings{WeissAPKM16_Measure_ISMIR,
author    = {Christof Wei{\ss} and Vlora Arifi-M{\"u}ller and Thomas Pr{\"a}tzlich and Rainer Kleinertz and Meinard M{\"u}ller},
title     = {Analyzing Measure Annotations for Western Classical Music Recordings},
booktitle = {Proceedings of the International Conference on Music Information Retrieval ({ISMIR})},
address   = {New York, USA},
year      = {2016},
pages     = {517--523},
url-pdf   = {2016_WeissAPKM_MeasureAnnotation_ISMIR_ePrint.pdf}
}
  7. Daniel Röwenstrunk, Thomas Prätzlich, Thomas Betzwieser, Meinard Müller, Gerd Szwillus, and Joachim Veit
    Das Gesamtkunstwerk Oper aus Datensicht — Aspekte des Umgangs mit einer heterogenen Datenlage im BMBF-Projekt Freischütz Digital
    Datenbank-Spektrum, 15(1): 65–72, 2015. PDF Details DOI 
    @article{RoewenstrunkPBMSV15_WeberOper_DBSK,
author    = {Daniel R{\"o}wenstrunk and Thomas Pr{\"a}tzlich and Thomas Betzwieser and Meinard M{\"u}ller and Gerd Szwillus and Joachim Veit},
title     = {{D}as {G}esamtkunstwerk {O}per aus {D}atensicht -- {A}spekte des {U}mgangs mit einer heterogenen {D}atenlage im {BMBF}-{P}rojekt {F}reisch{\"u}tz {D}igital},
journal   = {Datenbank-Spektrum},
volume    = {15},
number    = {1},
pages     = {65--72},
year      = {2015},
doi       = {10.1007/s13222-015-0179-0},
url-pdf   = {2015_RoewenstrunkPBMSV_FreiDi_DatenbankSpektrum.pdf},
url-details = {http://freischuetz-digital.de/}
}
  8. Christof Weiss and Meinard Müller
    Tonal Complexity Features for Style Classification of Classical Music
    In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP): 688–692, 2015. PDF 
    @inproceedings{WeissM15_TonalComplexity_ICASSP,
author    = {Christof Weiss and Meinard M{\"u}ller},
title     = {Tonal Complexity Features for Style Classification of Classical Music},
booktitle  = {Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
address  = {Brisbane, Australia},
year       = {2015},
pages    = {688--692},
url-pdf   = {2015_WeissMueller_TonalComplexity_ICASSP.pdf}
}
  9. Meinard Müller and Masataka Goto and Markus Schedl (ed.)
    Multimodal Music Processing
    In Dagstuhl Follow-Ups, Schloss Dagstuhl - Leibniz-Zentrum für Informatik, Germany, 3, 2012. PDF 
    @proceedings{MuellerGS12_MultimodalMusicProcessing_DagstuhlFU,
editor    = {Meinard M{\"u}ller and Masataka Goto and Markus Schedl},
title     = {Multimodal Music Processing},
booktitle = {Multimodal Music Processing},
publisher = {Schloss Dagstuhl - Leibniz-Zentrum f{\"u}r Informatik, Germany},
series    = {Dagstuhl Follow-Ups},
volume    = {3},
year      = {2012},
isbn      = {978-3-939897-37-8},
url-pdf={http://drops.dagstuhl.de/opus/volltexte/2011/3145/pdf/dagrep_v001_i001_p068_s11041.pdf}
}