An Analysis of Rhythmic Patterns with Unsupervised Learning
Source abstract
Abstract
This paper presents a model capable of learning the rhythmic characteristics of a music signal through unsupervised learning. The model learns a multi-layer hierarchy of rhythmic patterns ranging from simple structures on lower layers to more complex patterns on higher layers. The learned hierarchy is fully transparent, which enables observation and explanation of the structure of the learned patterns. The model employs tempo-invariant encoding of patterns and can thus learn and perform inference on tempo-varying and noisy input data. We demonstrate the model’s capabilities of learning distinctive rhythmic structures of different music genres using unsupervised learning. To test its robustness, we show how the model can efficiently extract rhythmic structures in songs with changing time signatures and live recordings. Additionally, the model’s time-complexity is empirically tested to show its usability for analysis-related applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Music and Audio Processing · Neuroscience and Music Perception · Music Technology and Sound Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Computer and Information Science, University of Ljubljana, Vecna pot 113, 1000 Ljubljana, Slovenia
School of Computer Science, University of Birmingham, University Rd W, Birmingham B15 2TT, UK
References (29)
Show source-provided references
1. The “Ticktock” of Our Internal Clock: Direct Brain Evidence of Subjective Accents in Isochronous Sequences10.1111/1467-9280.24441 ↗
2. Nonlinear Changes in the Rhythm of European Art Music: Quantitative Support for Historical Musicology10.1525/mp.2016.33.4.414 ↗
3. Toussaint, G.T. (2016). The Geometry of Musical Rhythm, Chapman and Hall/CRC.10.1201/b13751 ↗
4. Five Perspectives on Musical Rhythm10.1080/09298215.2014.996572 ↗
5. Rhythm and Tempo: An Introduction10.1093/mq/XXXVIII.3.384 ↗
6. The music information retrieval evaluation exchange (2005–2007): A window into music information retrieval research10.1250/ast.29.247 ↗
7. Dixon, S., Gouyon, F., and Widmer, G. (2004, January 10–14). Towards Characterisation of Music via Rhythmic Patterns. Proceedings of the International Conference on Music Information Retrieval (ISMIR), Barcelona, Spain.
8. From Genre Classification to Rhythm Similarity: Computational and Musicological Insights10.1080/09298215.2014.929706 ↗
9. Böck, S., Krebs, F., and Widmer, G. (2015, January 26–30). Accurate Tempo Estimation Based on Recurrent Neural Networks and Resonating Comb Filters. Proceedings of the International Conference on Music Information Retrieval (ISMIR), Málaga, Spain.
10. Bock, S. (2018, January 23–27). Submission to the MIREX 2018: BeatTracker. Proceedings of the MIREX 2018, Paris, France.
11. Bock, S., and Krebs, F. (2018, January 23–27). Submission to the MIREX 2018: DBNBeatTracker. Proceedings of the MIREX 2018, Paris, France.
12. Krebs, F., Böck, S., and Widmer, G. (2013, January 4–8). Rhythmic pattern modeling for beat and downbeat tracking in musical audio. Proceedings of the International Conference on Music Information Retrieval (ISMIR), Curitiba, Brazil.
13. Tone and Voice: A Derivation of the Rules of Voice-Leading from Perceptual Principles10.1525/mp.2001.19.1.1 ↗
14. Huron, D.B. (2006). Sweet Anticipation: Music and the Psychology of Expectation, MIT Press.10.7551/mitpress/6575.001.0001 ↗
15. Information dynamics: Patterns of expectation and surprise in the perception of music10.1080/09540090902733756 ↗
16. A generative model for the characterization of musical rhythms10.1080/09298215.2017.1409769 ↗
17. Foscarin, F., Jacquemard, F., and Rigaux, P. (2019, January 28–31). Modeling and Learning Rhythm Structure. Proceedings of the Sound & Music Computing Conference, Málaga, Spain.
18. Simonetta, F., Carnovalini, F., Orio, N., and Rodà, A. (2018, January 12–14). Symbolic Music Similarity through a Graph-Based Representation. Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion—AM’18, Wrexham, UK.10.1145/3243274.3243301 ↗
19. A Unified Probabilistic Model for Polyphonic Music Analysis10.1080/09298210902928495 ↗
20. Modeling Common-Practice Rhythm10.1525/mp.2010.27.5.355 ↗
21. Relation Between Surface Rhythm and Rhythmic Modes in Turkish Makam Music10.1080/09298215.2014.939661 ↗
22. Rhythm histograms and musical meter: A corpus study of Malian percussion music10.3758/s13423-016-1093-7 ↗
23. Panteli, M., and Dixon, S. (2016, January 7–11). On the Evaluation of Rhythmic and Melodic Descriptors for Music Similarity. Proceedings of the International Conference on Music Information Retrieval (ISMIR), New York, NY, USA.
24. Pesek, M., Leonardis, A., and Marolt, M. (2017). Robust Real-Time Music Transcription with a Compositional Hierarchical Model. PLoS ONE, 12.10.1371/journal.pone.0169411 ↗
25. Pesek, M., Leonardis, A., and Marolt, M. (2017). SymCHM—An Unsupervised Approach for Pattern Discovery in Symbolic Music with a Compositional Hierarchical Model. Appl. Sci., 7.10.3390/app7111135 ↗
26. Pesek, M., Žerovnik, M., Leonardis, A., and Marolt, M. (2018, January 26–29). Modeling song similarity with unsupervised learning. Proceedings of the Folk Music Analysis Workshop, Thessaloniki, Greece.
27. Pesek, M., Leonardis, A., and Marolt, M. (2014, January 27–31). A compositional hierarchical model for music information retrieval. Proceedings of the International Conference on Music Information Retrieval (ISMIR), Taipei, Taiwan.
28. Schluter, J., and Bock, S. (2013, January 23). Musical Onset Detection with Convolutional Neural Networks. Proceedings of the 6th International Workshop on Machine Learning and Music, Held in Conjunction with the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML/PKDD 2013, Prague, Czech Republic.
29. Ren, I.Y., Volk, A., Swierstra, W., and Veltkamp, R.C. (2018, January 23–27). Analysis by Classification: A Comparative Study of Annotated and Algorithmically Extracted Patterns in Symbolic Music Data. Proceedings of the International Conference on Music Information Retrieval (ISMIR), Paris, France.