journal article·2024-08-23Open access

Neural Coincidence Detection Strategies during Perception of Multi-Pitch Musical Tones

Rolf Bader

Applied Sciences· Volume 14· Issue 17

Abstract

Multi-pitch perception is investigated in a listening test using 30 recordings of musical sounds with two tones played simultaneously, except for two gong sounds with inharmonic overtone spectra, judging roughness and separateness as the ability to tell the two tones in each recording apart. Of the sounds, 13 were from a Western guitar playing all 13 intervals in one octave, the other sounds were mainly from non-Western instruments, comparing familiar with unfamiliar instrument sounds for Western listeners. Additionally the sounds were processed in a cochlea model, transferring the mechanical basilar membrane motion into neural spikes followed by post-processing simulating different degrees of coincidence detection. Separateness perception showed a clear distinction between familiar and unfamiliar sounds, while roughness perception did not. By correlating perception with simulation different perception strategies were found. Familiar sounds correlated strongly positively with high degrees of coincidence detection, where only 3–5 periodicities were left, while unfamiliar sounds correlated with low coincidence levels. This corresponds to an attention to pitch and timbre, respectively. Additionally, separateness perception showed an opposite correlation between perception and neural correlates between familiar and unfamiliar sounds. This correlates with the perceptional finding of the distinction between familiar and unfamiliar sounds with separateness.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Neuroscience and Music Perception · Music and Audio Processing · Hearing Loss and Rehabilitation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Musicology, University of Hamburg, Neue Rabenstr. 13, 20354 Hamburg, Germany

References (47)

Show source-provided references
1. Schneider, A. (2018). Pitch and Pitch Perception. Springer Handbook of Systematic Musicology, Springer.10.1007/978-3-662-55004-5_31 ↗
2. von Helmholtz, H. (1863). Die Lehre von den Tonempfindungen als Physiologische Grundlage für die Theorie der Musik [On the Sensations of Tone As a Physiological Basis for the Theory of Music], Vieweg, Braunschweig.
3. Schneider, A. (2018). Perception of Timbre and Sound Color. Springer Handbook of Systematic Musicology, Springer.10.1007/978-3-662-55004-5_32 ↗
4. Bregman, A.S. (1994). Auditory Scene Analysis: The Perceptual Organization of Sound, MIT Press.10.1121/1.408434 ↗
5. Multiple-instrument polyphonic music transcription using a temporally constrained shift-invariant model10.1121/1.4790351 ↗
6. Jansson, A., Bittner, R.M., Ewert, S., and Weyde, T. (2019, January 2–6). Joint singing voice separation and f0 estimation with deep u-net architectures. Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO), Coruña, Spain.10.23919/EUSIPCO.2019.8902550 ↗
7. McLeod, A., Schramm, R., Steedman, M., and Benetos, E. (2017). Automatic transcription of polyphonic vocal music. Appl. Sci., 7.10.3390/app7121285 ↗
8. Schramm, R. (2021). Automatic Transcription of Polyphonic Vocal Music. Handbook of Artificial Intelligence for Music. Foundations, Advanced Approaches and Developments for Creativity, Springer.10.1007/978-3-030-72116-9_25 ↗
9. Singing voice separation using a deep convolutional neural network trained by ideal binary mask and cross entropy10.1007/s00521-018-3933-z ↗
10. Dessein, A., Cont, A., and Lemaitre, G. (2010, January 9–13). Real-time polyphonic music transcription with non-negative matrix factorization and beta-divergence. Proceedings of the ISMIR—11th International Society for Music Information Retrieval Conference, Utrecht, The Netherlands.
11. Multi-Layer Combined Frequency and Periodicity Representations for Multi-Pitch Estimation of Multi-Instrument Music
12. Adaptive harmonic spectral decomposition for multiple pitch estimation10.1109/TASL.2009.2034186 ↗
13. Perceptual evaluations of synthesized musical instrument tones10.1121/1.381508 ↗
14. Isolating the dynamic attributes of musical timbre10.1121/1.407371 ↗
15. Perceptual scaling of synthesized musical timbres: Common dimensions, specifities, and latent subject classes
16. Bader, R. (2013). Nonlinearities and Synchronization in Musical Acoustics and Music Psychology, Springer. Current Research in Systematic Musicology.10.1007/978-3-642-36098-5 ↗
17. Ziemer, T., and Schultheis, H. (2022). PAMPAS: A Psycho-Acoustical Method for the Perceptual Analysis of multidimensional Sonification. Front. Neurosci., 16.10.3389/fnins.2022.930944 ↗
18. Bader, R. (2017). Pitch and timbre discrimination at wave-to-spike transition in the cochlea. arXiv.10.1121/1.5036320 ↗
19. Haken, H. (2008). Brain Dynamics, Springer Series in Synergetics, Springer. [2nd ed.].
20. Global workspace dynamics: Cortical binding and propagation enables conscious contents10.3389/fpsyg.2013.00200 ↗
21. Rapid feature selective neuronal synchronization through correlated latency shifting10.1038/84032 ↗
22. What makes us tick? Functional and neural mechanisms of interval timing10.1038/nrn1764 ↗
23. Neuronal synchronization of musical large-scale form: An EEG-study
24. Spatiotemporal analysis of prepyriform, visual, auditory, and somesthetic surface EEGs in trained rabbits10.1152/jn.1996.76.1.520 ↗
25. Kozma, R., and Freeman, W.J. (2016). Cognitive Phase Transitions in the Cerebral Cortex—Enhancing the Neuron Doctrine by Modeling Neural Fields, Springer. Springer Series Studies, System, Decision, and Control.10.1007/978-3-319-24406-8 ↗
26. Kozma, R., and Freeman, W.J. (2016). On the Creation of Meaning in the Brain—Cortical Neurodynamics During Category Learning. Cognitive Phase Transitions in the Cerebral Cortex—Enhancing the Neuron Doctrine by Modeling Neural Fields, Springer. Springer Series Studies, System, Decision, and Control.
27. Cochlea spike synchronization and coincidence detection model
28. What, if anything, is coincidence detection?10.1121/10.0023418 ↗
29. Enhancement of neural synchronization in the anteroventral cochlea nucleus. I. Responses to tones at the characteristic frequency10.1152/jn.1994.71.3.1022 ↗
30. Enhancement of neural synchronization in the anteroventral cochlea nucleus. II. Responses in the tuning curve tail10.1152/jn.1994.71.3.1037 ↗
31. Kreeger, L.J., Honnuraiah, S., Maeker, S., and Goodrich, L.V. (2024). An anatomical and physiological basis for coincidence detection across time scales in the auditory system. bioRxiv.10.1101/2024.02.29.582808 ↗
32. Stoll, A., Maier, A., Krauss, P., and Schilling, A. (2023). Coincidence detection and integration behavior in spiking neural networks. Cogn. Neurodyn., 1–13.10.1007/s11571-023-10038-0 ↗
33. Ryugo, D.K., Fay, R.R., and Popper, A.N. (2011). Central Decending Auditory Pathways. Auditory and Vestibular Efferents, Springer.10.1007/978-1-4419-7070-1 ↗
34. Buzsáki, G. (2006). Rhythms of the Brain, Oxford University Press.10.1093/acprof:oso/9780195301069.001.0001 ↗
35. Ferrante, M., Ciferri, M., and Toschi, N. (2024). R&B—Rhythm and Brain: Cross-subject Decoding of Music from Human Brain Activity. arXiv.
36. Thaut, M. (2007). Rhythm, Music, and the Brain: Scientific Foundations and Clinical Applications, Routledge.
37. A quantitative model of the “effective” signal processing in the auditory system. I. Model structure10.1121/1.414959 ↗
38. A quantitative model of the “effective” signal processing in the auditory system. II. Simulations and measurements10.1121/1.414960 ↗
39. Efficient coding of natural sounds10.1038/nn831 ↗
40. Temporal Codes, Timing Nets, and Music Perception10.1076/jnmr.30.2.107.7115 ↗
41. Temporal Coding of Periodicity Pitch in the Auditory System: An Overview10.1155/NP.1999.147 ↗
42. Verification of the Optimal Probabilistic Basis of Aural Processing of Pitch of Complex Tones10.1121/1.381749 ↗
43. Bader, R. (2021). How Music Works—A Physical Culture Theory, Springer.10.1007/978-3-030-67155-6 ↗
44. Sawicki, J., Hartmann, L., Bader, R., and Schöll, E. (2020). Modelling the perception of music in brain network dynamics. Front. Netw. Physiol., 2.10.3389/fnetp.2022.910920 ↗
45. Bader, R. (2024). Modeling Temporal Lobe Epilepsy during Music Large-Scale Form Perception Using the Impulse Pattern Formulation (IPF) Brain Model. Electronics, 13.10.3390/electronics13020362 ↗
46. Linke, S., Bader, R., and Mores, R. (2021). Modeling synchronization in human musical rhythms using Impulse Pattern Formulation (IPF). arXiv.
47. Rossing, T. (2001). Science of Percussion Instruments, World Scientific.10.1142/4294 ↗