journal article·2025-03-06Open access

Development and Implementation of a Machine Learning Model to Identify Emotions in Children with Severe Motor and Communication Impairments

Caryn Vowles, Kate Patterson, T. Claire Davies

Applied Sciences· Volume 15· Issue 5

Abstract

Children with severe motor and communication impairments (SMCIs) face significant challenges in expressing emotions, often leading to unmet needs and social isolation. This study investigated the potential of machine learning to identify emotions in children with SMCIs through the analysis of physiological signals. A model was created based on the data from the DEAP online dataset to identify the emotions of typically developing (TD) participants. The DEAP model was then adapted for use by participants with SMCIs using data collected within the Building and Designing Assistive Technology Lab (BDAT). Key adaptations to the DEAP model resulted in the exclusion of respiratory signals, a reduction in wavelet levels, and the analysis of shorter-duration data segments to enhance the model’s applicability. The adapted SMCI model demonstrated an accuracy comparable to the DEAP model, performing better than chance in TD populations and showing promise for adaptation to SMCI contexts. The models were not reliable for the effective identification of emotions; however, these findings highlight the feasibility of using machine learning to bridge communication gaps for children with SMCIs, enabling better emotional understanding. Future efforts should focus on expanding the data collection of physiological signals for diverse populations and developing personalized models to account for individual differences. This study underscores the importance of collecting data from populations with SMCIs for the development of inclusive technologies to promote empathetic care and enhance the quality of life of children with communication difficulties.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Emotion and Mood Recognition · Autism Spectrum Disorder Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Mechanical and Materials Engineering, Queen’s University, Kingston, ON K7L 3N6, Canada

Funding

Natural Science and Engineering Research Council of Canada · CREATE

References (33)

Show source-provided references
1. Children with medical complexity: An emerging population for clinical and research initiatives10.1542/peds.2010-0910 ↗
2. Patterns and costs of health care use of children with medical complexity10.1542/peds.2012-0175 ↗
3. Berry, J.G. (2015). What Children with Medical Complexity, Their Families, and Healthcare Providers Deserve from an Ideal Healthcare System, Lucile Packard’s Foundation for Children’s Health.
4. Child Well-being: A Systematic Review of the Literature10.1023/A:1021284215801 ↗
5. Direct assessment of emotional well-being from children with severe motor and communication impairment: A systematic review10.1080/17483107.2020.1810334 ↗
6. Emotional Well-Being of Children and Youth with Severe Motor and Communication Impairment: A Conceptual Understanding10.1080/17518423.2022.2099997 ↗
7. United Nations (1990). Convention on the Rights of the Child, UN.
8. Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach10.1109/TSMCA.2008.918624 ↗
9. Yoo, G., and Hong, S. (2016, January 15–17). Emotion Evaluation Analysis and System Design of Biosignal. Proceedings of the 2016 International Conference on Platform Technology and Service (PlatCon), Jeju, Republic of Korea.10.1109/PlatCon.2016.7456797 ↗
10. An accurate emotion recognition system using ECG and GSR signals and matching pursuit method10.1016/j.bj.2017.11.001 ↗
11. Domínguez-Jiménez, J.A., Campo-Landines, K.C., Martínez-Santos, J.C., Delahoz, E.J., and Contreras-Ortiz, S.H. (2020). A machine learning model for emotion recognition from physiological signals. Biomed. Signal Process. Control, 55.10.1016/j.bspc.2019.101646 ↗
12. Is heart rate variability (HRV) an adequate tool for evaluating human emotions? A focus on the use of the International Affective Picture System (IAPS)10.1016/j.psychres.2017.02.025 ↗
13. AffectButton: A method for reliable and valid affective self-report10.1016/j.ijhcs.2013.02.003 ↗
14. Zhang, S., Wu, Z., Meng, H.M., and Cai, L. (2010). Facial Expression Synthesis Based on Emotion Dimensions for Affective Talking Avatar. Modeling Machine Emotions for Realizing Intelligence, Springer.10.1007/978-3-642-12604-8_6 ↗
15. Vowles, C.J. (2025). Development and Testing of a System to Interpret Emotion for Children with Severe Motor and Communication Impairments (SMCI). [Ph.D. Thesis, Queen’s University].
16. Universal Facial Expressions of Emotion
17. DEAP: A Database for Emotion Analysis; Using Physiological Signals10.1109/T-AFFC.2011.15 ↗
18. Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time10.1016/j.cub.2013.11.064 ↗
19. Self-report captures 27 distinct categories of emotion bridged by continuous gradients10.1073/pnas.1702247114 ↗
20. Emotion Recognition for Everyday Life Using Physiological Signals From Wearables: A Systematic Literature Review10.1109/TAFFC.2022.3176135 ↗
21. Vowles, C., Collins, M.C., and Davies, T.C. (2024, January 15–19). Assessing Basic Emotion via Machine Learning: Comparative Analysis of Number of Basic Emotions and Algorithms. Proceedings of the Annual International Conference IEEE Engineering in Medicine and Biology Society, Orlando, FL, USA.10.1109/EMBC53108.2024.10782053 ↗
22. ECG Pattern Analysis for Emotion Detection10.1109/T-AFFC.2011.28 ↗
23. Zied, G., Lachiri, Z., Maaoui, C., and Pruski, A. (2015, January 18–20). Emotion recognition from physiological signals using fusion of wavelet based features. Proceedings of the 7th International Conference on Modelling, Identification and Control (ICMIC), Sousse, Tunisia.
24. Evaluation of Novel Entropy-Based Complex Wavelet Sub-bands Measures of PPG in an Emotion Recognition System10.1007/s40846-020-00526-7 ↗
25. Health Canada (2019). List of Recognized Standards for Medical Devices, Health Canada.
26. Interventions using high-technology communication devices: A state of the art review10.1159/000338250 ↗
27. El-Lahib, Y., El Morr, C., and Gorman, R. (2025). Challenges with recruitment, collection, and analysis: A research study on physiological signals and emotional experiences in youth with severe motor and communication impairments. Beyond Tech Fixes: Towards an AI Future Where Disability Justice Thrives, Springer.
28. Lang, P.J., Bradley, M.M., and Cuthbert, B.N. (2008). International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual, University of Florida.
29. Scikit-Learn Developers (2025, February 26). User Guide. Available online: https://scikit-learn.org/stable/user_guide.html.
30. NeuroKit2: A Python toolbox for neurophysiological signal processing10.3758/s13428-020-01516-y ↗
31. Holbrook, R., and Cook, A. (2024, August 15). Principal Component Analysis: Discover New Features by Analyzing Variation. Available online: https://www.kaggle.com/code/ryanholbrook/principal-component-analysis/data.
32. Predicting the duration of emotional experience: Two experience sampling studies10.1037/a0014610 ↗
33. Emotion Recognition Based on Physiological Changes in Music Listening10.1109/TPAMI.2008.26 ↗