Research on Contactless Bio-Signal Measurement Technology for Improving Social Awareness of Individuals with Communication Challenges
Source abstract
Abstract
Youth and adults with autism spectrum disorder have poor skills such as communication, qualitative interaction, and emotional expression resulting in low social awareness. In this paper, we propose and explore a contactless bio-signal measurement and functional contents for improving social awareness of individuals with communication challenges. We implemented four individual methods for collecting and analyzing the bio data of the individuals without requiring their attention: (1) heart rate, (2) respiration, (3) facial expression, and (4) interaction. The four techniques are all based on image data received and analyzed from a normal web camera. The data were analyzed in a real-time, fully functional algorithm: implementing the algorithm on a mobile device will require future work. However, we have evaluated our method by developing a functional content including the four methods. Based on the analysis of the collected data from the content and qualitative responses from the field, the contactless bio-signal measurement technology combined with friendly designed user interfaces for the individuals with communication challenges could train them to improve their social awareness.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Autism Spectrum Disorder Research · Neuroscience and Neural Engineering · EEG and Brain-Computer Interfaces
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Korea Electronics Technology Institute, Gwangju 61011, Korea
Funding
Ministry of Culture, Sports and Tourism and Korea Creative Content Agency
References (36)
Show source-provided references
1. Myles, B.S., and Simpson, R.L. (2003). Asperger Syndrome: A Guide for Educators and Parents.
2. Schopler, E., and Mesibov, G.B. (1992). High-Functioning Individuals with Autism, Springer.10.1007/978-1-4899-2456-8 ↗
3. Resolving ambiguity: A psycholinguistic approach to understanding prosody processing in high-functioning autism10.1016/j.bandl.2008.04.002 ↗
4. Acoustic differences in the imitation of prosodic patterns in children with autism spectrum disorders10.1016/j.rasd.2011.03.012 ↗
5. Emotional facial and vocal expressions during story retelling by children and adolescents with high-functioning autism10.1044/1092-4388(2012/12-0067) ↗
6. Stagg, S.D., Slavny, R., Hand, C., Cardoso, A., and Smith, P. (2013). Does facial expressivity count? how typically developing children respond initially to children with autism. Autism.10.1177/1362361313492392 ↗
7. Can neurotypical individuals read autistic facial expressions? Atypical production of emotional facial expressions in autism spectrum disorders10.1002/aur.1508 ↗
8. Meta-analysis of Early Intensive Behavioral Intervention for children with autism10.1080/15374410902851739 ↗
9. Lange, C.G., and James, W. (1922). A Series of Reprints and Translations. The Emotions, Williams & Wilkins Co.10.1037/10735-000 ↗
10. The James-Lange Theory of Emotions: A Critical Examination and an Alternative Theory10.2307/1415404 ↗
11. Expression recognition and behavioral problems in early adolescence10.1016/S0885-2014(01)00039-9 ↗
12. Chung, S.Y., and Yoon, H.J. (2011, January 8–12). A Framework for Treatment of Autism Using Affective Computing. Proceedings of the 18th Medicine Meets Virtual Reality (MMVR), Newport Beach, CA, USA.
13. On the Application of Quantitative EEG for Characterizing Autistic Brain: A Systematic Review10.3389/fnhum.2013.00442 ↗
14. Sensory processing in autism: A review of neurophysiologic findings10.1203/PDR.0b013e3182130c54 ↗
15. Heart Rate Variability and Skin Conductance During Repetitive TMS Course in Children with Autism10.1007/s10484-015-9311-z ↗
16. Cabibihan, J.-J., Javed, H., Aldosari, M., Frazier, T., and Elbashir, H. (2016). Sensing Technologies for Autism Spectrum Disorder Screening and Intervention. Sensors, 17.10.3390/s17010046 ↗
17. Analysis of physiological signals for recognition of boredom, pain, and surprise emotions10.1186/s40101-015-0063-5 ↗
18. Yu, S.-N., and Chen, S.-F. (2015, January 25–29). Emotion state identification based on heart rate variability and genetic algorithm. Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milano, Italy.10.1109/EMBC.2015.7318418 ↗
19. Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour
20. Attention does not modulate neural responses to social stimuli in autism spectrum disorders10.1016/j.neuroimage.2006.02.037 ↗
21. Cremers, D., Reid, I., Saito, H., and Yang, M.H. (2015). Modeling the Temporality of Saliency. Computer Vision—Proceedings of the ACCV 2014: 12th Asian Conference on Computer Vision, Singapore, 1–5 November 2014, Springer International Publishing. Revised Selected Papers, Part III.
22. The application of eye-tracking technology in the study of autism10.1113/jphysiol.2007.133587 ↗
23. A test of central coherence theory: Can adults with high-functioning autism or Asperger syndrome integrate objects in context?10.1080/13506280042000036 ↗
24. Visual scanning of faces in autism10.1023/A:1016374617369 ↗
25. Defining and quantifying the social phenotype in autism10.1176/appi.ajp.159.6.895 ↗
26. Holistic and part-based face recognition in children with autism10.1111/1469-7610.00142 ↗
27. Abnormal use of facial information in high-functioning autism10.1007/s10803-006-0232-9 ↗
28. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. European Conference on Computer Vision, Proceedings of the ECCV 2016, Amsterdam, The Netherlands, 11–14 October 2016, Springer.10.1007/978-3-319-46448-0_2 ↗
29. Viola, P., and Jones, M. (2001, January 8–14). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, USA.
30. Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. (2004). High Accuracy Optical Flow Estimation Based on a Theory for Warping. European Conference on Computer Vision, Proceedings of the ECCV 2004, Prague, Czech Republic, 11–14 May 2004, Springer.10.1007/978-3-540-24673-2_3 ↗
31. Algorithm AS 136: A K-Means Clustering Algorithm10.2307/2346830 ↗
32. Simoudis, E., Han, J., and Fayyad, U.M. (1996, January 2–4). A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, Portland, OR, USA.
33. Zadeh, A., Baltrusaitis, T., and Morency, L.-P. (2017, January 22–29). Convolutional Experts Constrained Local Model for Facial Landmark Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.256 ↗
34. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of oriented gradients for human detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA.
35. Wrnch (2021, April 04). What is Human-Centric Computer Vision?. Available online: https://wrnch.ai/technology/.
36. DISFA: A Spontaneous Facial Action Intensity Database10.1109/T-AFFC.2013.4 ↗