International Audio Laboratories Erlangen

Freischütz Digital: Data and Demos

The project Freischütz Digital funded by the German Federal Ministry of Education and Research, was a close cooperation between musicologists and computer scientists to explore new and digital ways for analyzing and presenting music related data in critical editions. The opera "Der Freischütz" by Carl Maria von Weber offered a large number of (historical) sources including different versions of the musical score, the libretto, and (multitrack) audio recordings.

On this website, we present audio-related demos and resources from the project Freischütz Digital.

Demos

Multitrack Dataset

Within the Freischütz Digital project, three numbers (No. 6, 8, and 9) of the opera "Der Freischütz" have been produced by the Erich-Thienhaus-Institute (HfM Detmold). The main purpose for the recording sessions was to produce royalty free audio material that can be used for demonstration and research purposes. The recording was carried out by the Tonmeister students Stefan Antonin (No. 6), Florian Bitzer (No. 8), and Matthias Kieslich (No. 9) under the supervision of Prof. Dipl-Tonm. Bernhard Güttler, and Prof. Dipl-Tonm. Michael Sandner. Besides a professional stereo mix of the three numbers, the dataset provides the raw multitrack recordings from the individual microphones as well as individual group mixes that emphasize different voices or instrument sections.

Got to dataset

Multitrack Single Microphone Switcher

The Single Microphone Switcher is a demo for exploring the recordings of the individual microphones used in the Freischütz Multitrack Dataset recordings. It sketches how the microphones were positioned in the room. The interface provides the possibility to listen to the individual microphone recordings. Furthermore, the instrument activation matrix, provides a visualization that shows which instruments are currently active (black) or inactive (white) at the current playback position.

Got to demo page

Instrument Equalizer

An instrument equalizer provides the possibility to adjust the volume of an individual instrument in a recording without affecting the volume of the other instruments.

Got to demo page

Score Follower & Interpretation Switcher

Publications

1. Thomas Prätzlich and Meinard Müller
   Freischütz Digital: A Case Study for Reference-based Audio Segmentation of Operas
   In Proceedings of the International Society for Music Information Retrieval Conference (ISMIR): 589–594, 2013. Bibtex

   @inproceedings{PraetzlichM13_ReferenceBasedSegmentation_ISMIR,
   author    = {Thomas Pr{\"a}tzlich and Meinard M{\"u}ller},
   title     = {Freisch{\"u}tz Digital: A Case Study for Reference-based Audio Segmentation of Operas},
   booktitle = {Proceedings of the International Society for Music Information Retrieval Conference ({ISMIR})},
   address   = {Curitiba, Brazil},
   year      = {2013},
   pages     = {589--594},
   }

2. Meinard Müller, Thomas Prätzlich, Benjamin Bohl, and Joachim Veit
   Freischütz Digital: a multimodal scenario for informed music processing
   In Proceedings of the International Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIAMIS), 2013. Bibtex

   @inproceedings{MuellerPBV13_FreischuetzDigital_WIAMIS,
   author    = {Meinard M{\"u}ller and Thomas Pr{\"a}tzlich and Benjamin Bohl and Joachim Veit},
   title     = {{F}reisch{\"u}tz {D}igital: a multimodal scenario for informed music processing},
   booktitle = {Proceedings of the International Workshop on Image and Audio Analysis for Multimedia Interactive Services ({WIAMIS})},
   address   = {Paris, France},
   year      = {2013},
   pages     = {},
   }

3. Jonathan Driedger, Harlad Grohganz, Thomas Prätzlich, Sebastian Ewert, and Meinard Müller
   Score-Informed Audio Decomposition and Applications
   In Proceedings of the ACM International Conference on Multimedia (ACM-MM): 541–544, 2013. Bibtex

   @inproceedings{DriedgerGPEM13_AudioDecomposition_ACM-MM,
   author = {Jonathan Driedger and Harlad Grohganz and Thomas Pr{\"a}tzlich and Sebastian Ewert and Meinard M{\"u}ller},
   title = {Score-Informed Audio Decomposition and Applications},
   booktitle = {Proceedings of the ACM International Conference on Multimedia ({ACM-MM})},
   address = {Barcelona, Spain},
   year = {2013},
   pages = {541--544},
   }

4. Thomas Prätzlich and Meinard Müller
   Frame-Level Audio Segmentation for Abridged Musical Works
   In Proceedings of the International Conference on Music Information Retrieval (ISMIR), 2014. Bibtex

   @inproceedings{PraetzlichM14_AudioTrackSeg_ISMIR,
   author    = {Thomas Pr{\"a}tzlich and Meinard M{\"u}ller },
   title     = {Frame-Level Audio Segmentation for Abridged Musical Works},
   booktitle = {Proceedings of the International Conference on Music Information Retrieval ({ISMIR})},
   address   = {Taipei, Taiwan},
   year      = {2014},
   pages     = {},
   }

5. Thomas Prätzlich, Rachel Bittner, Antoine Liutkus, and Meinard Müller
   Kernel additive modeling for interference reduction in multi-channel music recordings
   In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2015. Bibtex

   @inproceedings{PraetzlichBLM15_KAMIR_ICASSP,
   title={Kernel additive modeling for interference reduction in multi-channel music recordings},
   author={Thomas Pr{\"a}tzlich and Rachel Bittner and Antoine Liutkus and Meinard M{\"u}ller},
   booktitle={Proceedings of the {IEEE} International Conference on Acoustics, Speech, and Signal Processing ({ICASSP})},
   location = {Brisbane, Australia},
   year = {2015}
   }