A Swingogram Representation for Tracking Microrhythmic Variations in Jazz Performances

This is the accompanying website for the following paper:

  1. Christian Dittmar, Martin Pfleiderer, Stefan Balke, and Meinard Müller
    A Swingogram Representation for Tracking Micro-Rhythmic Variation in Jazz Performances
    Journal of New Music Research, 47(2): 97–113, 2017. Demo DOI
    @article{DittmarPBM17_SwingRatio_JNMR,
    author = {Christian Dittmar and Martin Pfleiderer and Stefan Balke and Meinard M{\"u}ller},
    title = {A Swingogram Representation for Tracking Micro-Rhythmic Variation in Jazz Performances},
    journal = {Journal of New Music Research},
    volume = {47},
    number = {2},
    pages = {97--113},
    year = {2017},
    doi = {10.1080/09298215.2017.1367405},
    url-demo={https://www.audiolabs-erlangen.de/resources/MIR/2017-JNMR-SwingRatio},
    }

Abstract

Teaser_Swingogram

According to musicological studies, a typical microrhythmic trait of jazz performances is the "swing". In this paper, we focus on analyzing the swing ratio (beat-upbeat ratio) implied by the drummer on the ride cymbal. Extending previous work, we propose a new method for semi-automatic swing ratio estimation based on pattern recognition in onset sequences. As a main contribution, we introduce a novel time-swing ratio representation called swingogram, which locally captures information related to the swing ratio over time. Based on this representation, we propose to track the most plausible trajectory of the swing ratio of the ride cymbal pattern over time via dynamic programming. As we show, this kind of visualization may lead to interesting insights into the peculiarities of jazz musicians improvising together.

Swingogram Examples from the Weimar Jazz Database

Under the following links, we show interesting examples of jazz excerpts from the Weimar Jazz Database (WJD), where we can spot intricate microrhythmic variations throughout the solo. Our swingogram visualization and a piano-roll representation of the solo is synced with the corresponding part of a Youtube video. The Youtube video player will automatically start playing, you can use the normal video player controls to navigate inside the excerpt.

[The Red Door - Mel Lewis (Drums) & Gerry Mulligan (Baritone Sax)]
[Down Under - Art Blakey (Drums) & Freddie Hubbard (Trumpet)]
[Blue Train - Philly Joe Jones (Drums) & Curtis Fuller (Trombone)]

Illustrative Example of the Swingogram

In the audio player below, we show three different representations of a synthetic music signal that contains 100 repetitions of a prototype ride cymbal pattern. With each measure, we steadily increase the tempo, yielding a tempo sweep between 146 BPM and 328 BPM. We fix the swing ratio in each measure to the tied-triplet feel of 2.0. In the top row, we show a Fourier-based tempogram as described in [2]. In the middle row, we show a sequence of log-lag ACF features as described in [3]. Finally, in the bottom row we show our proposed swingogram representation that extends our pattern matching technique from [1].

websiteIncreasingTempoSwingogram

Processed items from the WJD

In the following, we list all the excerpts that we used for the large-scale statistical model about the relationship between tempo and swing ratio.

MelID Artist Title Drummer Soloist Tempo (avg.) Swing Ratio (avg.) Swing Ratio (std. dev.)
1 Art Pepper Anthropology Billy Higgins Art Pepper (cl) 218.8 1.66 0.18
2 Art Pepper Blues for Blanche Billy Higgins Art Pepper (as) 198.9 1.90 0.10
4 Art Pepper In A Mellow Tone Billy Higgins Art Pepper (cl) 167.6 2.25 0.21
32 Bob Berg I Didn't Know What Time It Was Billy Higgins Bob Berg (ts) 126.7 2.36 0.19
34 Bob Berg No Moe Dennis Chambers Bob Berg (ts) 161.8 2.26 0.13
39 Cannonball Adderley High Fly Louis Hayes Cannonball Adderley (as) 128.9 2.23 0.09
40 Cannonball Adderley So What James Cobb Cannonball Adderley (as) 142.2 2.80 0.47
43 Cannonball Adderley Work Song Louis Hayes Cannonball Adderley (as) 156.3 2.16 0.10
59 Chet Baker Two's Blues Steve Gadd Chet Baker (tp) 202.2 1.94 0.53
69 Clifford Brown Daahoud Max Roach Clifford Brown (tp) 240.9 1.74 0.24
72 Clifford Brown Jordu Max Roach Clifford Brown (tp) 139 2.42 0.11
82 Curtis Fuller Blue Train Philly Joe Jones Curtis Fuller (tb) 131.8 2.36 0.34
83 Curtis Fuller Down Under Art Blakey Curtis Fuller (tb) 147.4 3.34 0.08
92 David Liebman There Will Never Be Another You Jamey Haddad David Liebman (ts) 151.7 2.36 0.13
99 Dexter Gordon Cheese Cake Billy Higgins Dexter Gordon (ts) 220.9 1.99 0.04
100 Dexter Gordon Montmartre Albert 'Tootie' Heath Dexter Gordon (ts) 204.2 2.01 0.19
102 Dexter Gordon Stanley The Steamer Albert 'Tootie' Heath Dexter Gordon (ts) 181.2 2.57 0.26
103 Dexter Gordon The Rainbow People Albert 'Tootie' Heath Dexter Gordon (ts) 120 3.07 0.24
127 Eric Dolphy 245 Roy Hanes Eric Dolphy (as) 71.2 2.11 0.13
129 Eric Dolphy Dahomey Dance Elvin Jones Eric Dolphy (as) 128.9 2.27 0.10
137 Freddie Hubbard Dolphin Dance Tony Wiliams Freddie Hubbard (tp) 118.9 2.87 0.29
138 Freddie Hubbard Down Under Art Blakey Freddie Hubbard (tp) 146.1 3.50 0.08
141 Freddie Hubbard Speak No Evil Elvin Jones Freddie Hubbard (tp) 143.2 2.20 0.20
143 Gerry Mulligan Scrapple From The Apple Stan Levey Gerry Mulligan (bs) 252 1.99 0.03
144 Gerry Mulligan The Red Door Mel Lewis Gerry Mulligan (bs) 236.4 2.01 0.01
146 Hank Mobley Doodlin' Art Blakey Hank Mobley (ts) 121.3 3.30 0.12
157 J.J. Johnson Yesterdays Connie Kay J.J. Johnson (tb) 125.1 2.44 0.17
161 Joe Henderson Punjab Elvin Jones Joe Henderson (ts) 160.1 2.30 0.20
162 Joe Henderson Serenity Elvin Jones Joe Henderson (ts) 157.3 2.43 0.13
167 Joe Lovano I Can't Get Started Billy Hart Joe Lovano (ts-c) 106.8 2.36 0.14
169 Joe Lovano Lonnie's Lament Lewis Nash Joe Lovano (ts) 201 1.99 0.18
172 John Coltrane 26-2 Elvin Jones John Coltrane (ts) 194.5 2.07 0.11
175 John Coltrane Countdown Art Taylor John Coltrane (ts) 337.6 1.24 0.03
177 John Coltrane Giant Steps Art Taylor John Coltrane (ts) 299.2 1.55 0.08
180 John Coltrane Mr. P.C. Art Taylor John Coltrane (ts) 258.2 1.73 0.18
182 John Coltrane My Favorite Things Elvin Jones John Coltrane (ss) 178.9 2.32 0.26
192 Joshua Redman Home Fries Brian Blade Joshua Redman (ts) 181.4 2.24 0.15
198 Kenny Dorham Doodlin' Art Blakey Kenny Dorham (tp) 121.1 3.40 0.14
201 Kenny Dorham Punjab Elvin Jones Kenny Dorham (tp) 154.9 2.33 0.17
202 Kenny Dorham Serenity Elvin Jones Kenny Dorham (tp) 154.9 2.50 0.13
216 Lee Morgan Blue Train Philly Joe Jones Lee Morgan (tp) 133.6 2.38 0.37
237 Michael Brecker Delta City Blues Jeffrey Watts Michael Brecker (ts) 281.7 1.24 0.09
238 Michael Brecker I Mean You Aaron Scott Michael Brecker (ts) 180 2.15 0.11
239 Michael Brecker Midnight Voyage Jack DeJohnette Michael Brecker (ts) 125.6 3.06 0.29
245 Miles Davis Airegin Kenny Clarke Miles Davis (tp) 241.3 2.13 0.04
261 Nat Adderley Work Song Louis Hayes Nat Adderley (tp) 155.4 2.16 0.09
266 Ornette Coleman Ramblin' Billy Higgins Ornette Coleman (as) 201.3 2.30 0.15
269 Pat Metheny Nothing Personal Jack DeJohnette Pat Metheny (g) 242.1 1.43 0.21
273 Paul Desmond Blue Rondo a la Turk Joe Morello Paul Desmond (as) 117.1 2.38 0.07
293 Sonny Rollins Blue Seven Max Roach Sonny Rollins (ts) 133.3 2.30 0.22
298 Sonny Rollins Tenor Madness Max Roach Sonny Rollins (ts) 175.6 2.33 0.11
310 Stan Getz Crazy Rhythm Connie Kay Stan Getz (ts) 287.9 1.13 0.01
313 Stan Getz My Funny Valentine Connie Kay Stan Getz (ts) 130.7 2.44 0.06
319 Steve Coleman Slipped again Ed Blackwell Steve Coleman (as) 131.6 2.39 0.35
323 Steve Lacy Alone together Dennis Charles Steve Lacy (ss) 134.9 2.91 0.33
325 Steve Lacy Easy To Love Dennis Charles Steve Lacy (ss) 166.3 2.50 0.25
326 Steve Lacy Let's Cool One Billy Higgins Steve Lacy (ss) 132.2 3.02 0.23
328 Steve Lacy Work Dennis Charles Steve Lacy (ss) 165.9 2.48 0.26
331 Steve Turre Steve's Blues Carl Allen Steve Turre (tb) 204.3 2.35 0.10
337 Wayne Shorter Down Under Art Blakey Wayne Shorter (ts) 147.1 3.50 0.08
340 Wayne Shorter Footprints Joe Chambers Wayne Shorter (ts) 136.1 1.79 0.18
344 Wayne Shorter Orbits Tony Williams Wayne Shorter (ts) 267.1 1.15 0.03
345 Wayne Shorter Speak No Evil Elvin Jones Wayne Shorter (ts) 142.7 2.24 0.23
346 Woody Shaw Dat Dere Carl Allen Woody Shaw (tp) 114.7 2.58 0.25
347 Woody Shaw If I Were A Bell Carl Allen Woody Shaw (tp) 252.3 1.88 0.29
352 Woody Shaw Steve's Blues Carl Allen Woody Shaw (tp) 205.5 2.30 0.11
355 Wynton Marsalis U.M.M.G. Gregory Hutchinson Wynton Marsalis (tp) 221.3 1.79 0.41

References

  1. Christian Dittmar, Martin Pfleiderer, and Meinard Müller
    Automated Estimation of Ride Cymbal Swing Ratios in Jazz Recordings
    In Proceedings of the International Conference on Music Information Retrieval (ISMIR): 271–277, 2015. PDF
    @inproceedings{DittmarPM15_Swing_ISMIR,
    author    = {Christian Dittmar and Martin Pfleiderer and Meinard M{\"u}ller},
    title     = {Automated Estimation of Ride Cymbal Swing Ratios in Jazz Recordings},
    booktitle = {Proceedings of the International Conference on Music Information Retrieval ({ISMIR})},
    address   = {M\'{a}laga, Spain},
    year      = {2015},
    pages     = {271--277},
    url-pdf   = {http://ismir2015.uma.es/articles/143_Paper.pdf}
    }
  2. Peter Grosche and Meinard Müller
    Extracting Predominant Local Pulse Information from Music Recordings
    IEEE Transactions on Audio, Speech, and Language Processing, 19(6): 1688–1701, 2011. Details DOI
    @article{GroscheM11_PLP_TASLP,
    author    = {Peter Grosche and Meinard M{\"u}ller},
    journal   = {IEEE Transactions on Audio, Speech, and Language Processing},
    title     = {Extracting Predominant Local Pulse Information from Music Recordings},
    number    = {6},
    publisher = {IEEE},
    volume    = {19},
    year      = {2011},
    pages     = {1688--1701},
    doi      = {10.1109/TASL.2010.2096216},
    url-details = {https://www.audiolabs-erlangen.de/resources/MIR/tempogramtoolbox}
    }
  3. Matthias Gruhne and Christian Dittmar
    Improving Rhythmic Pattern Features Based on Logarithmic Preprocessing
    In Proceedings of the Audio Engineering Society (AES) Convention, 2009. PDF
    @inproceedings{GruhneD09_LogLagACF_AES,
    author = {Matthias Gruhne and Christian Dittmar},
    title = {Improving Rhythmic Pattern Features Based on Logarithmic Preprocessing},
    booktitle = {Proceedings of the Audio Engineering Society ({AES}) Convention},
    address = {Munich, Germany},
    year = {2009},
    url-pdf = {http://www.aes.org/e-lib/browse.cfm?elib=15013},
    }
  4. Fernando Benadon
    Slicing the beat: Jazz eighth-notes as expressive microrhythm
    Ethnomusicology: 73–98, 2006. PDF
    @article{Benadon06_SwingRatio_EM,
    title     = {Slicing the beat: Jazz eighth-notes as expressive microrhythm},
    author    = {Fernando Benadon},
    journal   = {Ethnomusicology},
    pages     = {73--98},
    year      = {2006},
    publisher = {JSTOR},
    url-pdf   = {https://www.jstor.org/stable/pdf/20174424.pdf},
    }
  5. Anders Friberg and Andreas Sundström
    Swing Ratios and Ensemble Timing in Jazz Performance: Evidence for a common Rhythmic Pattern
    Music Perception, 19(3): 333–349, 2002. PDF
    @article{FribergS02_SwingRatio_MP,
    title     = {Swing Ratios and Ensemble Timing in Jazz Performance: Evidence for a common Rhythmic Pattern},
    author    = {Anders Friberg and Andreas Sundstr{\"o}m},
    journal   = {Music Perception},
    volume    = {19},
    number    = {3},
    pages     = {333--349},
    year      = {2002},
    publisher = {JSTOR}
    url-pdf   = {https://www.jstor.org/stable/pdf/10.1525/mp.2002.19.3.333.pdf},
    }