journal article·2023-04-25Open access

A New Technical Ear Training Game and Its Effect on Critical Listening Skills

Sungyoung Kim, Jacob Cozzarin

Applied Sciences· Volume 13· Issue 9

Abstract

Technical ear training has proven to be an effective tool for developing the skills of junior audio engineers and enhancing their proficiency in audio and music production. To provide a comprehensive auditory training experience, the authors have created a gamified training program that encompasses four modules: spectral identification, auditory localization, consistent judgment, and memory of a mix balance. Each module is designed to give trainees closed-loop audiomotor training, allowing them to instantly assess their performance and identify areas where they need to improve. This new ear-training game helped players to be more engaged and resulted in the improvement of trained audio engineering skills. Moreover, the game also benefited a non-trained auditory skill, speech understanding in noise.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music Technology and Sound Studies · Hearing Loss and Rehabilitation · Music and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Engineering Technology, Rochester Institute of Technology, Rochester, NY 14623, USA

Graduate School of Culture Technology, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea

Golisano College of Computing and Information Sciences, Rochester Institute of Technology, Rochester, NY 14623, USA

Funding

Yamaha Corporation

References (47)

Show source-provided references
1. Indelicato, M.J., Hochgraf, C., and Kim, S. (2014, January 9–12). How Critical Listening Exercises Complement Technical Courses to Effectively Provide Audio Education for Engineering Technology Students. Proceedings of the Audio Engineering Society 137th International Convention, AES, Los Angeles, CA, USA.
2. Perspectives of advanced ear training using audio plug-ins10.17743/jaes.2020.0029 ↗
3. A review of literature in critical listening education10.17743/jaes.2022.0004 ↗
4. Timbre Solfege: A Course in Technical Listening for Sound Engineers
5. Quesnel, R. (1996, January 11–14). Timbral Ear Trainer: Adaptive, Interactive Training of Listening Skills for Evaluation of Timbre. Proceedings of the Audio Engineering Society 100th International Convention, AES, Copenhagen, Denmark. Preprint 4241.
6. Zacharov, N. (2019). Sensory Evaluation of Sound, CRC Press.10.1201/9780429429422 ↗
7. ITU-R (1996). Recommendation P.800, Methods for Subjective Determination of Transmission Quality, International Telecommunications Union Radiocommunication Assembly.
8. ITU-R (2015). Recommendation BS.1534-5, Method for the Subjective Assessment of Intermediate Quality Level of Coding Systems, International Telecommunications Union Radiocommunication Assembly.
9. Effect of Audio Production Experience, Musical Training, and Age on Listener Performance in 3D Audio Evaluation10.17743/jaes.2019.0031 ↗
10. Influence of the Listening Environment on Recognition of Immersive Reproduction of Orchestral Music Sound Scenes10.17743/jaes.2021.0035 ↗
11. Differences in Performance and Preference of Trained versus Untrained Listeners in Loudspeaker Tests: A Case Study
12. International, H. (2023, February 10). Harman’s How To Listen. Available online: http://harmanhowtolisten.blogspot.com/2011/01/welcome-to-how-to-listen.html.
13. Olive, S.E. (2001, January 12–15). A new listener training software application. Proceedings of the Audio Engineering Society 110th International Convention, AES, Amsterdam, The Netherlands. Preprint 5384.
14. Technical Listening Training: Improvement of sound sensitivity for acoustic engineers and sound designers10.1250/ast.24.27 ↗
15. Sleeman, D., and Brown, J. (1982). Intelligent Tutoring Systems, Academic Press.
16. Games, motivation, and learning: A research and practice model10.1177/1046878102238607 ↗
17. Troubadour: A Gamified e-Learning Platform for Ear Training10.1109/ACCESS.2020.2994389 ↗
18. Neurofeedback Training of Auditory Selective Attention Enhances Speech-In-Noise Perception10.3389/fnhum.2021.676992 ↗
19. Auditory Localization Training Using Generalized Head Related Transfer Functions in Augmented Reality10.1250/ast.39.312 ↗
20. Audiomotor Perceptual Training Enhances Speech Intelligibility in Background Noise10.1016/j.cub.2017.09.014 ↗
21. Effects of Long-Term Training on Aided Speech-Recognition Performance in Noise in Older Adults10.1044/1092-4388(2008/054) ↗
22. Benefits of Phoneme Discrimination Training in a Randomized Controlled Trial of 50- to 74-Year-Olds With Mild Hearing Loss10.1097/AUD.0000000000000020 ↗
23. Putting brain training to the test10.1038/nature09042 ↗
24. Auditory Training: Evidence for Neural Plasticity in Older Adults10.1044/hhd17.1.37 ↗
25. A European Perspective on Auditory Processing Disorder-Current Knowledge and Future Research Focus10.3389/fneur.2017.00622 ↗
26. Common Misconceptions Regarding Pediatric Auditory Processing Disorder10.3389/fneur.2017.00732 ↗
27. A specific relationship between musical sophistication and auditory working memory10.1038/s41598-022-07568-8 ↗
28. Musical training, individual differences and the cocktail party problem10.1038/srep11628 ↗
29. Inter-subject differences in personalized technical ear training and the influence of an individually optimized training sequence10.1250/ast.34.424 ↗
30. An assessment of individualized technical ear training for audio production10.1121/1.4922622 ↗
31. An Assessment of a Spatial ear Training Program for Perceived Auditory Source Width10.1121/1.4998185 ↗
32. Kim, S., and Olive, S.E. (2015, January 7–10). Assessing influence of a Headphone Type on Individualized ear Training. Proceedings of the Audio Engineering Society 138th International Convention, AES, Warsaw, Poland.10.1121/1.4922622 ↗
33. A cross-cultural comparison of preferred spectral balances for headphone-reproduced music10.1250/ast.38.272 ↗
34. Kim, S., Choi, I., and Schwalje, A.T. (2019, January 9–13). Sound Localization Training Using Augmented Reality. Proceedings of the Association for Research in Otolaryngology Midwinter Meeting 2019, ARO, Baltimore, MD, USA.
35. Bakker, R., Ikeda, M., and Kim, S. (2014, January 9–12). Performance and Response: A framework to discuss the quality of audio systems. Proceedings of the AES 137th International Convention E-Brif., AES, Los Angeles, CA, USA.
36. Letowski, T. (1989, January 18–21). Sound quality assessment: Concepts and criteria. Proceedings of the Audio Engineering Society 87th International Convention, New York, NY, USA. Preprint 2825.
37. Corey, J. (2016). Audio Production and Critical Listening, Routledge. [2nd ed.].10.4324/9781315727813 ↗
38. Rapid head-related transfer function adaptation using a virtual auditory environment10.1121/1.3687448 ↗
39. Chon, S.H., and Kim, S. (2019, January 23–27). The Matter of Attention and Motivation—Understanding Unexpected Results from Auditory Localization Training using Augmented Reality. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8797683 ↗
40. Working Memory Underpins Cognitive Development, Learning, and Education10.1007/s10648-013-9246-y ↗
41. Over-diagnosis of cognitive deficits in psychiatric patients may be the result of not controlling for hearing sensitivity and auditory processing10.1111/pcn.12768 ↗
42. A speech corpus for multitalker communications research10.1121/1.428288 ↗
43. Selective spatial attention modulates bottom-up informational masking of speech10.1038/srep08662 ↗
44. The effect of spatially separated sound sources on speech intelligibility10.1044/jshr.1201.05 ↗
45. Chon, S.H., and Kim, S. (2017, January 25–27). Does Technical ear Training Also Improve Speech-In-Noise Identification?. Proceedings of the 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music, APSCOM, Kyoto, Japan.
46. Bisogno, A., Scarpa, A., Girolamo, S.D., Luca, P.D., Cassandro, C., Viola, P., Ricciardiello, F., Greco, A., Vincentiis, M.D., and Ralli, M. (2021). Hearing Loss and Cognitive Impairment: Epidemiology, Common Pathophysiological Findings, and Treatment Considerations. Life, 11.10.3390/life11101102 ↗
47. Efficacy of Auditory Training in Elderly Subjects10.3389/fnagi.2015.00078 ↗