journal article·2025-04-10Open access

SEM-Net: A Social–Emotional Music Classification Model for Emotion Regulation and Music Literacy in Individuals with Special Needs

Yu-Chi Chou, Shan-Ken Chien, Pen-Chiang Chao, Yuan-Jin Lin, Chih-Yun Chen, Kuang-Kai Yeh, Yen-Chia Peng, Chen-Hao Tsao, Shih-Lun Chen, Kuo-Chen Li

Applied Sciences· Volume 15· Issue 8

Abstract

This study aims to establish an innovative AI-based social–emotional music classification model named SEM-Net, specifically designed to integrate three core positive social–emotional elements—positive outlook, empathy, and problem-solving—into classical music, facilitating accurate emotional classification of musical excerpts related to emotional states. SEM-Net employs a convolutional neural network (CNN) architecture composed of 17 meticulously structured layers to capture complex emotional and musical features effectively. To further enhance the precision and robustness of the classification system, advanced social–emotional music feature preprocessing and sophisticated feature extraction techniques were developed, significantly improving the model’s predictive performance. Experimental results demonstrate that SEM-Net achieves an impressive final classification accuracy of 94.13%, substantially surpassing the baseline method by 54.78% and outperforming other widely used deep learning architectures, including conventional CNN, LSTM, and Transformer models, by at least 27%. The proposed SEM-Net system facilitates emotional regulation and meaningfully enhances emotional and musical literacy, social communication skills, and overall quality of life for individuals with special needs, offering a practical, scalable, and accessible tool that contributes significantly to personalized emotional growth and social–emotional learning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Humanities and Education, Chung Yuan Christian University, Taoyuan City 32023, Taiwan

Department of Special Education, National Taiwan Normal University, Taipei City 106308, Taiwan

Department of Program on Semiconductor Manufacturing Technology, Academy of Innovative Semiconductor and Sustainable Manufacturing, National Cheng Kung University, Tainan City 701401, Taiwan

Department of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, Taiwan

Department of Information and Computer Engineering, Chung Yuan Christian University, Taoyuan City 32023, Taiwan

Department of Information Management, Chung Yuan Christian University, Taoyuan City 320317, Taiwan

Funding

National Science and Technology Council (NSTC), Taiwan · National Chip Implementation Center, Taiwan

References (29)

Show source-provided references
1. Theory of Mind, Socio-Emotional Problem-Solving, Socio-Emotional Regulation in Children with Intellectual Disability and in Typically Developing Children10.1007/s10803-012-1651-4 ↗
2. Davidson, R.J., and Begley, S. (2012). The Emotional Life of Your Brain: How Its Unique Patterns Affect the Way You Think, Feel, and Live—And How You Can Change Them, Avery Publishing Group.
3. Nguyen, W., Ownsworth, T., Nicol, C., and Zimmerman, D. (2020). How I See and Feel About Myself: Domain-Specific Self-Concept and Self-Esteem in Autistic Adults. Front. Psychol., 11.10.3389/fpsyg.2020.00913 ↗
4. Facilitating Academic and Mental Health Resilience in Students with a Learning Disability
5. Empathy Research and Teacher Preparation: Benefits and Obstacles
6. The Neural Bases for Empathy10.1177/1073858410379268 ↗
7. Musical Literacy10.2307/3332852 ↗
8. Effect of educational music intervention on emotion regulation skills of first-year university music education students10.1097/MD.0000000000032041 ↗
9. The impact of musicking on emotion regulation: A systematic review and meta-analysis10.1177/03057356231212362 ↗
10. Bibliotherapy and Social and Emotional Learning in the Elementary Music Setting10.1177/27527646231154541 ↗
11. Use of Music in Special Education and Application Examples from Turkey10.1016/j.sbspro.2014.01.617 ↗
12. Western Classical Music and General Education10.2979/PME.2003.11.2.130 ↗
13. Separate neural substrates for skill learning and performance in the ventral and dorsal striatum10.1038/nn1817 ↗
14. The Insula and Its Epilepsies10.1177/1535759718822847 ↗
15. A functional MRI study of happy and sad affective states induced by classical music10.1002/hbm.20337 ↗
16. From emotion perception to emotion experience: Emotions evoked by pictures and classical music10.1016/j.ijpsycho.2005.04.007 ↗
17. Automatic music genre classification based on musical instrument track separation10.1007/s10844-017-0464-5 ↗
18. Improving Music Genre Classification Using Automatically Induced Harmony Rules10.1080/09298215.2010.525654 ↗
19. Genre classification of music by tonal harmony; IOS Press10.3233/IDA-2010-0437 ↗
20. FSD50K: An Open Dataset of Human-Labeled Sound Events10.1109/TASLP.2021.3133208 ↗
21. Automated Dysarthria Severity Classification: A Study on Acoustic Features and Deep Learning Techniques10.1109/TNSRE.2022.3169814 ↗
22. CTC-Based Learning of Chroma Features for Score–Audio Music Retrieval10.1109/TASLP.2021.3110137 ↗
23. Speech Emotion Recognition and Deep Learning: An Extensive Validation Using Convolutional Neural Networks10.1109/ACCESS.2023.3326071 ↗
24. Audio Features for Music Emotion Recognition: A Survey10.1109/TAFFC.2020.3032373 ↗
25. Abayomi-Alli, O.O., Damaševičius, R., Qazi, A., Adedoyin-Olowe, M., and Misra, S. (2022). Data Augmentation and Deep Learning Methods in Sound Classification: A Systematic Review. Electronics, 11.10.3390/electronics11223795 ↗
26. Zhang, S., Liu, Y., and Zhou, M. (2025). Graph Neural Network and LSTM Integration for Enhanced Multi-Label Style Classification of Piano Sonatas. Sensors, 25.10.3390/s25030666 ↗
27. Wang, J., Li, S., and Sung, Y. (2023). Deformer: Denoising Transformer for Improved Audio Music Genre Classification. Appl. Sci., 13.10.3390/app132312673 ↗
28. Bottom-up broadcast neural network for music genre classification10.1007/s11042-020-09643-6 ↗
29. Sharma, D.K., Peng, S.-L., Sharma, R., and Zaitsev, D.A. (2022). Music Genre Classification Using CNN and RNN-LSTM. Micro-Electronics and Telecommunication Engineering, Springer Nature.10.1007/978-981-16-8721-1 ↗