Drumroll Please: Modeling Multi-Scale Rhythmic Gestures with Flexible Grids

Abstract: 

We present a new data representation for music modeling and generation called a Flexible Grid. This representation aims to balance flexibility with structure in order to encode all the musical events (notes or rhythmic onsets) in a dataset without quantizing or discarding any temporal information. In experiments with a dataset of MIDI drum performances, we find that when implemented in a Variational AutoEncoder (VAE) model, Flexible Grid representations can enable detailed generation of music performance data that includes multiple different gestures and articulations.

Author: 
Jon Gillick
Joshua Yang
David Bamman
Publication date: 
November 17, 2021
Publication type: 
Journal Article
Citation: 
Gillick, J., Yang, J., Cella, C.-E., & Bamman, D. (2021). Drumroll please: Modeling multi-scale rhythmic gestures with flexible grids. Transactions of the International Society for Music Information Retrieval, 4(1). https://doi.org/10.5334/tismir.98