journal article·2023-01-19Open access

An HMM-Based Approach for Cross-Harmonization of Jazz Standards

Maximos Kaliakatsos-Papakostas, Konstantinos Velenis, Leandros Pasias, Chrisoula Alexandraki, Emilios Cambouropoulos

Applied Sciences· Volume 13· Issue 3

Abstract

This paper presents a methodology for generating cross-harmonizations of jazz standards, i.e., for harmonizing the melody of a jazz standard (Song A) with the harmonic context of another (Song B). Specifically, the melody of Song A, along with the chords that start and end its sections (chord constraints), are used as a basis for generating new harmonizations with chords and chord transitions taken from Song B. This task involves potential incompatibilities between the components drawn from the two songs that take part in the cross-harmonization. In order to tackle such incompatibilities, two methods are introduced that are integrated in the Hidden Markov Model and the Viterbi algorithm. First, a rudimentary approach to chord grouping is presented that allows interchangeable utilization of chords belonging to the same group, depending on melody compatibility. Then, a “supporting” harmonic space of chords and probabilities is employed, which is learned from the entire dataset of the available jazz standards; this space provides local solutions when there are insurmountable conflicts between the melody and constraints of Song A and the harmonic context of Song B. Statistical and expert evaluation allow an analysis of the methodology, providing valuable insight about future steps.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Music Technology and Sound Studies · Neuroscience and Music Perception

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Music Studies, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece

Department of Music Technology and Acoustics, Hellenic Mediterranean University, 741 33 Rethymno, Greece

Funding

European Regional Development Fund of the European Union and Greek national funds

References (44)

Show source-provided references
1. Fauconnier, G., and Turner, M. (2003). The Way We Think: Conceptual Blending and the Mind’s Hidden Complexities, reprint ed., Basic Books.
2. Zbikowski, L.M. (2002). Conceptualizing Music: Cognitive Structure, Theory, and Analysis, Oxford University Press.10.1093/acprof:oso/9780195140231.001.0001 ↗
3. Zbikowski, L.M. (2008). Metaphor and music. The Cambridge Handbook of Metaphor and Thought, Cambridge University Press.10.1017/CBO9780511816802.030 ↗
4. Conceptual blending, creativity, and music10.1177/1029864917712783 ↗
5. Andler, D., Ogawa, Y., Okada, M., and Watanabe, S. (2006). Mathematical models of cognitive space and time. Reasoning and Cognition, Keio University Press.
6. Argamon, S., and Dubnov, S. (2010). Style: A computational and conceptual blending-based approach. The Structure of Style: Algorithmic Approaches to Understanding Manner and Meaning, Springer.10.1007/978-3-642-12337-5 ↗
7. Conceptual Blending of Harmonic Spaces for Creative Melodic Harmonisation10.1080/09298215.2017.1355393 ↗
8. Conceptual blending and analogy
9. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm10.1109/TIT.1967.1054010 ↗
10. The viterbi algorithm10.1109/PROC.1973.9030 ↗
11. Machine learning of jazz grammars10.1162/COMJ_a_00006 ↗
12. Miranda, E.R. (2000). Dynamic programming for interactive music systems. Readings in Music and Artificial Intelligence, Harwood Academic Publishers.
13. Lokki, T., Patynen, J., and Valimaki, V. (2017, January 5–8). Jazz piano trio synthesizing system based on HMM and DNN. Proceedings of the 14th Sound and Music Computing Conference 2017, SMC 2017, Espoo, Finland.
14. Hung, H.T., Wang, C.Y., Yang, Y.H., and Wang, H.M. (2019, January 18–21). Improving automatic jazz melody generation by transfer learning techniques. Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Lanzhou, China.10.1109/APSIPAASC47483.2019.9023224 ↗
15. Keller, R., and Morrison, D. (2007, January 11–13). A grammatical approach to automatic improvisation. Proceedings of the 4th Sound and Music Computing Conference, SMC, Lefkada, Greece.
16. Wiggins, G., and Smaill, A. (2013). Musical Knowledge: What can Artificial Intelligence bring to the musician?. Readings in Music and Artificial Intelligence, Routledge.
17. Hadjeres, G., Pachet, F., and Nielsen, F. (2017, January 6–11). Deepbach: A steerable model for bach chorales generation. Proceedings of the International Conference on Machine Learning, Sydney, Australia.
18. Liang, F.T., Gotham, M., Johnson, M., and Shotton, J. (2017, January 23–27). Automatic Stylistic Composition of Bach Chorales with Deep LSTM. Proceedings of the 18th International Society for Music Information Retrieval Conference, ISMIR 2017, Suzhou, China.
19. Lim, H., Rhyu, S., and Lee, K. (2017). Chord generation from symbolic melody using BLSTM networks. arXiv.
20. Huang, C.A., Hawthorne, C., Roberts, A., Dinculescu, M., Wexler, J., Hong, L., and Howcroft, J. (2019). The Bach Doodle: Approachable music composition with machine learning at scale. arXiv.
21. Huang, C.A., Cooijmans, T., Roberts, A., Courville, A.C., and Eck, D. (2019). Counterpoint by Convolution. arXiv.
22. Miranda, E.R. (2021). Cognitive musicology and Artificial Intelligence: Harmonic analysis, learning, and generation. Handbook of Artificial Intelligence for Music: Foundations, Advanced Approaches, and Developments for Creativity, Springer International Publishing.
23. Reconciling deep learning with symbolic artificial intelligence: Representing objects and relations10.1016/j.cobeha.2018.12.010 ↗
24. Marcus, G. (2018). Deep learning: A critical appraisal. arXiv.
25. The Markov process as a compositional model: A survey and tutorial10.2307/1575226 ↗
26. Saul, L., Weiss, Y., and Bottou, L. (2004). Harmonising chorales by probabilistic inference. Advances in Neural Information Processing Systems, MIT Press.
27. Functional harmonic analysis using probabilistic models10.1162/0148926041790676 ↗
28. Melody Harmonization With Interpolated Probabilistic Models10.1080/09298215.2013.822000 ↗
29. Koops, H.V., Magalhães, J.P., and de Haas, W.B. (2013, January 25–27). A Functional Approach to Automatic Melody Harmonisation. Proceedings of the First ACM SIGPLAN Workshop on Functional Art, Music, Modeling and Design, FARM ’13, Boston, MA, USA.10.1145/2505341.2505343 ↗
30. Yi, L., and Goldsmith, J. (2007, January 19). Automatic Generation of Four-part Harmony. Proceedings of the Fifth UAI Conference on Bayesian Modeling Applications Workshop, Vancouver, BC, Canada.
31. Ystad, S., Aramaki, M., Kronland-Martinet, R., and Jensen, K. (2011). Probabilistic and logic-based modelling of harmony. Exploring Music Contents, Springer.10.1007/978-3-642-23126-1 ↗
32. Miranda, E. (2021). Handbook of Artificial Intelligence for Music: Foundations, Advanced Approaches, and Developments for Creativity, Springer International Publishing.10.1007/978-3-030-72116-9 ↗
33. Kaliakatsos-Papakostas, M., and Cambouropoulos, E. (2014, January 14–20). Probabilistic harmonisation with fixed intermediate chord constraints. Proceedings of the Joint 11th Sound and Music Computing Conference (SMC) and 40th International Computer Music Conference (ICMC), ICMC–SMC 2014, Athens, Greece.
34. Kaliakatsos-Papakostas, M., Makris, D., Tsougras, C., and Cambouropoulos, E. (2016). Learning and Creating Novel Harmonies in Diverse Musical Idioms: An Adaptive Modular Melodic Harmonisation System. J. Creat. Music Syst., 1.10.5920/jcms.2016.01 ↗
35. Evaluating Human-Computer Co-creative Processes in Music: A Case Study on the CHAMELEON Melodic Harmonizer10.3389/fpsyg.2021.603752 ↗
36. Paiement, J.F., Eck, D., and Bengio, S. (2005, January 11–15). A Probabilistic Model for Chord Progressions. Proceedings of the Sixth International Conference on Music Information Retrieval (ISMIR), London, UK.
37. Kaliakatsos-Papakostas, M., Zacharakis, A., Tsougras, C., and Cambouropoulos, E. (2015, January 28–30). Evaluating the General Chord Type representation in tonal music and organising GCT chord labels in functional chord categories. Proceedings of the 4th International Conference on Music Information Retrieval (ISMIR 2015), Malaga, Spain.
38. An empirical study of smoothing techniques for language modeling10.1006/csla.1999.0128 ↗
39. Conceptual blending of high-level features and data-driven salience computation in melodic generation10.1016/j.cogsys.2019.05.003 ↗
40. Alexandraki, C., Akoumianakis, D., Kalochristianakis, M., Zervas, P., Maximos, K.P., and Cambouropoulos, E. (2022, January 6–8). MusiCoLab: Towards a modular architecture for collaborative music learning. Proceedings of the Web Audio Conference, Cannes, France.
41. Dannenberg, R.B. (2012). Human computer music performance. Dagstuhl Follow-Ups, Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.
42. Dannenberg, R.B. (October, January 29). A Vision of Creative Computation in Music Performance. Proceedings of the Second International Computer Music Conference, Singapore.
43. Raphael, C. (2011, January 27–29). Orchestral Musical Accompaniment from Synthesized Audio. Proceedings of the International Conference on Computational Creativity, Mexico City, Mexico.
44. Raphael, C. (2001, January 17–2). Music plus one: A system for flexible and expressive musical accompaniment. Proceedings of the International Computer Music Conference, Havana, Cuba.