Technology-Facilitated Diagnosis and Treatment of Individuals with Autism Spectrum Disorder: An Engineering Perspective
Source abstract
Abstract
The rapid development of computer and robotic technologies in the last decade is giving hope to perform earlier and more accurate diagnoses of the Autism Spectrum Disorder (ASD), and more effective, consistent, and cost-conscious treatment. Besides the reduced cost, the main benefit of using technology to facilitate treatment is that stimuli produced during each session of the treatment can be controlled, which not only guarantees consistency across different sessions, but also makes it possible to focus on a single phenomenon, which is difficult even for a trained professional to perform, and deliver the stimuli according to the treatment plan. In this article, we provide a comprehensive review of research on recent technology-facilitated diagnosis and treat of children and adults with ASD. Different from existing reviews on this topic, which predominantly concern clinical issues, we focus on the engineering perspective of autism studies. All technology facilitated systems used for autism studies can be modeled as human machine interactive systems where one or more participants would constitute as the human component, and a computer-based or a robotic-based system would be the machine component. Based on this model, we organize our review with the following questions: (1) What are presented to the participants in the studies and how are the content and delivery methods enabled by technologies? (2) How are the reactions/inputs collected from the participants in response to the stimuli in the studies? (3) Are the experimental procedure and programs presented to participants dynamically adjustable based on the responses from the participants, and if so, how? and (4) How are the programs assessed?
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Autism Spectrum Disorder Research · Neurological disorders and treatments
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Curriculum and Foundations, Cleveland State University, Cleveland, OH 44115, USA
Department of Electrical Engineering and Computer Science, Cleveland State University, Cleveland, OH 44115, USA
School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China
References (100+)
Show source-provided references
1. Wieckowski, A.T., and White, S.W. (2017). Application of technology to social communication impairment in childhood and adolescence. Neurosci. Biobehav. Rev.10.1016/j.neubiorev.2016.12.030 ↗
2. Technologies as support tools for persons with autistic spectrum disorder: A systematic review10.3390/ijerph110807767 ↗
3. Robots for use in autism research10.1146/annurev-bioeng-071811-150036 ↗
4. The clinical use of robots for individuals with autism spectrum disorders: A critical review10.1016/j.rasd.2011.05.006 ↗
5. Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism10.1007/s12369-013-0202-2 ↗
6. Autism and social robotics: A systematic review10.1002/aur.1527 ↗
7. Are robots ready to deliver autism interventions? a comprehensive review10.1007/s12369-016-0346-y ↗
8. Authenticity in Virtual Reality for assessment and intervention in autism: A conceptual review10.1016/j.edurev.2016.08.001 ↗
9. Zakari, H.M., Ma, M., and Simmons, D. (2014, January 9–10). A review of serious games for children with autism spectrum disorders (ASD). Proceedings of the International Conference on Serious Games Development and Applications, Berlin, Germany.10.1007/978-3-319-11623-5_9 ↗
10. Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD)10.1016/j.compedu.2017.05.002 ↗
11. Chuah, M.C., Coombe, D., Garman, C., Guerrero, C., and Spletzer, J. (2014, January 28–30). Lehigh instrument for learning interaction (lili): An interactive robot to aid development of social skills for autistic children. Proceedings of the IEEE 11th International Conference on Mobile Ad Hoc and Sensor Systems, Philadelphia, PA, USA.10.1109/MASS.2014.67 ↗
12. Marwecki, S., Rädle, R., and Reiterer, H. (2013). Encouraging Collaboration in Hybrid Therapy Games for Autistic Children. CHI ’13 Extended Abstracts on Human Factors in Computing Systems, ACM.10.1145/2468356.2468439 ↗
13. GOLIAH (Gaming Open Library for Intervention in Autism at Home): A 6-month single blind matched controlled exploratory study10.1186/s13034-017-0154-7 ↗
14. Chua, L., Goh, J., Nay, Z.T., Huang, L., Cai, Y., and Seah, R. (2017). ICT-Enabled Emotional Learning for Special Needs Education. Simulation and Serious Games for Education, Springer.10.1007/978-981-10-0861-0_3 ↗
15. Zhang, L., Gabriel-King, M., Armento, Z., Baer, M., Fu, Q., Zhao, H., Swanson, A., Sarkar, M., Warren, Z., and Sarkar, N. (2016, January 17–21). Design of a Mobile Collaborative Virtual Environment for Autism Intervention. Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Toronto, ON, Canada.10.1007/978-3-319-40238-3_26 ↗
16. Vullamparthi, A.J., Nelaturu, S.C.B., Mallaya, D.D., and Chandrasekhar, S. (2013, January 18–20). Assistive learning for children with autism using augmented reality. Proceedings of the 2013 IEEE Fifth International Conference on Technology for Education (T4E), Kharagpur, India.10.1109/T4E.2013.18 ↗
17. Neurohab: a platform for virtual training of daily living skills in autism spectrum disorder10.1016/j.protcy.2014.10.161 ↗
18. Cognitive rehabilitation system for children with autism spectrum disorder using serious games: A pilot study10.3233/BME-151373 ↗
19. Emotiplay: A serious game for learning about emotions in children with autism: Results of a cross-cultural evaluation10.1007/s00787-017-0968-0 ↗
20. Zhao, H., Swanson, A., Weitlauf, A., Warren, Z., and Sarkar, N. (2016, January 17–21). A Novel Collaborative Virtual Reality Game for Children with ASD to Foster Social Interaction. Proceedings of the International Conference on Universal Access in Human-Computer Interaction, Toronto, ON, Canada.10.1007/978-3-319-40238-3_27 ↗
21. GOLIAH: A gaming platform for home-based intervention in autism–principles and design10.3389/fpsyt.2016.00070 ↗
22. Bartoli, L., Corradi, C., Garzotto, F., and Valoriani, M. (2013, January 24–27). Exploring motion-based touchless games for autistic children’s learning. Proceedings of the 12th International Conference on Interaction Design and Children, New York, NY, USA.10.1145/2485760.2485774 ↗
23. Garzotto, F., Gelsomini, M., Oliveto, L., and Valoriani, M. (2014, January 27–29). Motion-based touchless interaction for ASD children: A case study. Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, Como, Italy.10.1145/2598153.2598197 ↗
24. Ge, Z., and Fan, L. (2017). Social Development for Children with Autism Using Kinect Gesture Games: A Case Study in Suzhou Industrial Park Renai School. Simulation and Serious Games for Education, Springer.10.1007/978-981-10-0861-0_8 ↗
25. Bartoli, L., Garzotto, F., Gelsomini, M., Oliveto, L., and Valoriani, M. (2014, January 17–20). Designing and Evaluating Touchless Playful Interaction for ASD Children. Proceedings of the 2014 Conference on Interaction Design and Children, Aarhus, Denmark.10.1145/2593968.2593976 ↗
26. Barajas, A.O., Al Osman, H., and Shirmohammadi, S. (2017, January 2–4). A Serious Game for children with Autism Spectrum Disorder as a tool for play therapy. Proceedings of the 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH), Perth, WA, Australia.10.1109/SeGAH.2017.7939266 ↗
27. Designing serious game interventions for individuals with autism10.1007/s10803-014-2333-1 ↗
28. Social attention in a virtual public speaking task in higher functioning children with autism10.1002/aur.1302 ↗
29. Visuospatial attention in children with Autism Spectrum Disorder: A comparison between 2-D and 3-D environments10.1080/2331186X.2017.1307709 ↗
30. Design and application of an immersive virtual reality system to enhance emotional skills for children with autism spectrum disorders10.1016/j.compedu.2016.03.018 ↗
31. Bozgeyikli, L., Bozgeyikli, E., Raij, A., Alqasemi, R., Katkoori, S., and Dubey, R. (2016, January 20). Vocational training with immersive virtual reality for individuals with autism: Towards better design practices. Proceedings of the 2016 IEEE 2nd Workshop on Everyday Virtual Reality (WEVR), Greenville, SC, USA.10.1109/WEVR.2016.7859539 ↗
32. Bozgeyikli, E., Raij, A., Katkoori, S., and Dubey, R. (2016, January 15–16). Locomotion in Virtual Reality for Individuals with Autism Spectrum Disorder. Proceedings of the 2016 Symposium on Spatial User Interaction, Tokyo, Japan.10.1145/2983310.2985763 ↗
33. Ip, H.H., Wong, S.W., Chan, D.F., Byrne, J., Li, C., Yuan, V.S., Lau, K.S., and Wong, J.Y. (2016, January 19–21). Virtual reality enabled training for social adaptation in inclusive education settings for school-aged children with autism spectrum disorder (ASD). Proceedings of the International Conference on Blending Learning, Beijing, China.10.1007/978-3-319-41165-1_9 ↗
34. Using a 3D immersive virtual environment system to enhance social understanding and social skills for children with autism spectrum disorders10.1177/1088357615583473 ↗
35. Maskey, M., Lowry, J., Rodgers, J., McConachie, H., and Parr, J.R. (2014). Reducing specific phobia/fear in young people with autism spectrum disorders (ASDs) through a virtual reality environment intervention. PLoS ONE, 9.10.1371/journal.pone.0100374 ↗
36. Bozgeyikli, L., Bozgeyikli, E., Clevenger, M., Gong, S., Raij, A., Alqasemi, R., Sundarrao, S., and Dubey, R. (2014, January 30). VR4VR: Towards vocational rehabilitation of individuals with disabilities in immersive virtual reality environments. Proceedings of the 2014 2nd Workshop on Virtual and Augmented Assistive Technology (VAAT), Minneapolis, MN, USA.10.1109/VAAT.2014.6799466 ↗
37. Design of a virtual reality based adaptive response technology for children with autism10.1109/TNSRE.2012.2218618 ↗
38. Are children with autism more responsive to animated characters? A study of interactions with humans and human-controlled avatars10.1007/s10803-014-2116-8 ↗
39. Amaral, C.P., Simões, M.A., and Castelo-Branco, M.S. (2015). Neural Signals Evoked by Stimuli of Increasing Social Scene Complexity Are Detectable at the Single-Trial Level and Right Lateralized. PLoS ONE, 10.10.1371/journal.pone.0121970 ↗
40. Understanding the psycho-physiological implications of interaction with a virtual reality-based system in adolescents with autism: a feasibility study10.1109/TNSRE.2015.2393891 ↗
41. A physiologically informed virtual reality based social communication system for individuals with autism10.1007/s10803-014-2240-5 ↗
42. Brain responses to biological motion predict treatment outcome in young adults with autism receiving Virtual Reality Social Cognition Training: Preliminary findings10.1016/j.brat.2017.03.014 ↗
43. Self-reported sense of presence and responses to social stimuli by adolescents with ASD in a collaborative virtual reality environment10.3109/13668250.2016.1234032 ↗
44. Reduced mimicry to virtual reality avatars in Autism Spectrum Disorder10.1007/s10803-016-2930-2 ↗
45. Virtual reality social cognition training for children with high functioning autism10.1016/j.chb.2016.04.033 ↗
46. Virtual-reality-based social interaction training for children with high-functioning autism10.1080/00220671.2013.832999 ↗
47. Using the virtual reality-cognitive rehabilitation approach to improve contextual processing in children with autism10.1155/2013/716890 ↗
48. Brief report: A pilot study of the use of a virtual reality headset in autism populations10.1007/s10803-016-2830-5 ↗
49. Level of immersion in virtual environments impacts the ability to assess and teach social skills in autism spectrum disorder10.1089/cyber.2014.0682 ↗
50. Wang, X., Desalvo, N., Gao, Z., Zhao, X., Lerman, D.C., Gnawali, O., and Shi, W. (2014, January 8–9). Eye Contact Conditioning in Autistic Children Using Virtual Reality Technology. Proceedings of the International Symposium on Pervasive Computing Paradigms for Mental Health, Tokyo, Japan.10.1007/978-3-319-11564-1_9 ↗
51. Li, Y., Elmaghraby, A.S., El-Baz, A., and Sokhadze, E.M. (2015, January 7–10). Using physiological signal analysis to design affective VR games. Proceedings of the 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Abu Dhabi, UAE.10.1109/ISSPIT.2015.7394401 ↗
52. Carter, E.J., Hyde, J., Williams, D.L., and Hodgins, J.K. (2016, January 7–12). Investigating the influence of avatar facial characteristics on the social behaviors of children with autism. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858345 ↗
53. Avatar assistant: improving social skills in students with an ASD through a computer-based intervention10.1007/s10803-011-1179-z ↗
54. Cai, Y., Chiew, R., Fan, L., Kwek, M.K., and Goei, S.L. (2017). The Virtual Pink Dolphins Project: An International Effort for Children with ASD in Special Needs Education. Simulation and Serious Games for Education, Springer.10.1007/978-981-10-0861-0_1 ↗
55. Design and development of a virtual dolphinarium for children with autism10.1109/TNSRE.2013.2240700 ↗
56. Feng, Y., and Cai, Y. (2017). A Gaze Tracking System for Children with Autism Spectrum Disorders. Simulation and Serious Games for Education, Springer.10.1007/978-981-10-0861-0_10 ↗
57. Design of a Physiology-Sensitive VR-Based Social Communication Platform for Children With Autism10.1109/TNSRE.2016.2613879 ↗
58. Halabi, O., El-Seoud, S.A., Alja’am, J.M., Alpona, H., Al-Hemadi, M., and Al-Hassan, D. (2017). Design of Immersive Virtual Reality System to Improve Communication Skills in Individuals with Autism. Int. J. Emerg. Technol. Learn., 12.10.3991/ijet.v12i05.6766 ↗
59. A virtual joy-stick study of emotional responses and social motivation in children with autism spectrum disorder10.1007/s10803-014-2036-7 ↗
60. Assessing the utility of a virtual environment for enhancing facial affect recognition in adolescents with autism10.1007/s10803-014-2035-8 ↗
61. Facing the challenge of teaching emotions to individuals with low-and high-functioning autism using a new Serious game: a pilot study10.1186/2040-2392-5-37 ↗
62. Subtle cues missed: Impaired perception of emotion from gait in relation to schizotypy and autism spectrum traits10.1016/j.schres.2016.11.003 ↗
63. Critical features for the perception of emotion from gait10.1167/9.6.15 ↗
64. Investigating Event Memory in Children with Autism Spectrum Disorder: Effects of a Computer-Mediated Interview10.1007/s10803-016-2959-2 ↗
65. Virtual reality social cognition training for young adults with high-functioning autism10.1007/s10803-012-1544-6 ↗
66. Li, C., Jia, Q., and Feng, Y. (2016, January 27–28). Human-Robot Interactoin Design for Robot-Assisted Intervention for Children with Autism Based on ES Theory. Proceedings of the 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), Hangzhou, China.10.1109/IHMSC.2016.103 ↗
67. Virtual reality and robots for autism: moving beyond the screen10.1108/JAT-09-2016-0018 ↗
68. De Haas, M., Aroyo, A.M., Barakova, E., Haselager, W., and Smeekens, I. (2016, January 4–6). The effect of a semi-autonomous robot on children. Proceedings of the 2016 IEEE 8th International Conference on Intelligent Systems (IS), Sofia, Bulgaria.10.1109/IS.2016.7737448 ↗
69. Bernardo, B., Alves-Oliveira, P., Santos, M.G., Melo, F.S., and Paiva, A. (2016, January 20–23). An Interactive Tangram Game for Children with Autism. Proceedings of the International Conference on Intelligent Virtual Agents, Los Angeles, CA, USA.10.1007/978-3-319-47665-0_63 ↗
70. Hong, T.S., Mohamaddan, S., Shazali, S.T.S., Mohtadzar, N.A.A., and Bakar, R.A. (2016, January 4–8). A review on assistive tools for autistic patients. Proceedings of the 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysia.10.1109/IECBES.2016.7843413 ↗
71. Feasibility study of a randomised controlled trial to investigate the effectiveness of using a humanoid robot to improve the social skills of children with autism spectrum disorder (Kaspar RCT): A study protocol10.1136/bmjopen-2017-017376 ↗
72. Improving therapeutic outcomes in autism spectrum disorders: Enhancing social communication and sensory processing through the use of interactive robots10.1016/j.jpsychires.2017.02.004 ↗
73. Wong, H., and Zhong, Z. (2016, January 16–19). Assessment of robot training for social cognitive learning. Proceedings of the 2016 16th International Conference on Control, Automation and Systems (ICCAS), Gyeongju, Korea.10.1109/ICCAS.2016.7832420 ↗
74. Using robot animation to promote gestural skills in children with autism spectrum disorders10.1111/jcal.12159 ↗
75. Bharatharaj, J., Huang, L., Al-Jumaily, A.M., Krageloh, C., and Elara, M.R. (2016, January 18–20). Effects of Adapted Model-Rival Method and parrot-inspired robot in improving learning and social interaction among children with autism. Proceedings of the 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), Kollam, India.10.1109/RAHA.2016.7931905 ↗
76. Accessible robots for improving social skills of individuals with autism10.1515/jaiscr-2016-0020 ↗
77. Suzuki, R., and Lee, J. (2016, January 28–30). Robot-play therapy for improving prosocial behaviours in children with Autism Spectrum Disorders. Proceedings of the 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS), Nagoya, Japan.10.1109/MHS.2016.7824238 ↗
78. A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism10.1007/s12369-013-0195-x ↗
79. Using the humanoid robot KASPAR to autonomously play triadic games and facilitate collaborative play among children with autism10.1109/TAMD.2014.2303116 ↗
80. Using the social robot probo as a social story telling agent for children with ASD10.1075/is.13.3.02van ↗
81. Kajopoulos, J., Wong, A.H.Y., Yuen, A.W.C., Dung, T.A., Kee, T.Y., and Wykowska, A. (2015, January 26–30). Robot-assisted training of joint attention skills in children diagnosed with autism. Proceedings of the International Conference on Social Robotics, Paris, France.10.1007/978-3-319-25554-5_30 ↗
82. Bharatharaj, J., Huang, L., Al-Jumaily, A.M., Krageloh, C., and Elara, M.R. (2016, January 13–15). Experimental evaluation of parrot-inspired robot and adapted model-rival method for teaching children with autism. Proceedings of the 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), Phuket, Thailand.10.1109/ICARCV.2016.7838636 ↗
83. Bharatharaj, J., Huang, L., Mohan, R.E., Al-Jumaily, A., and Krägeloh, C. (2017). Robot-Assisted Therapy for Learning and Social Interaction of Children with Autism Spectrum Disorder. Robotics, 6.10.3390/robotics6010004 ↗
84. A Feasibility Study Evaluating the Emotionally Expressive Robot SAM10.1007/s12369-017-0419-6 ↗
85. Can robotic interaction improve joint attention skills?10.1007/s10803-013-1918-4 ↗
86. Wiese, E., Müller, H.J., and Wykowska, A. (2014, January 27–29). Using a gaze-cueing paradigm to examine social cognitive mechanisms of individuals with autism observing robot and human faces. Proceedings of the International Conference on Social Robotics, Sydney, Australia.10.1007/978-3-319-11973-1_38 ↗
87. Hirokawa, M., Funahashi, A., Pan, Y., Itoh, Y., and Suzuki, K. (2016, January 26–31). Design of a robotic agent that measures smile and facing behavior of children with Autism Spectrum Disorder. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.10.1109/ROMAN.2016.7745217 ↗
88. Yun, S.S., Choi, J., and Park, S.K. (2016, January 26–31). Robotic behavioral intervention to facilitate eye contact and reading emotions of children with autism spectrum disorders. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.10.1109/ROMAN.2016.7745194 ↗
89. Yun, S.S., Park, S.K., and Choi, J. (2014, January 25–29). A robotic treatment approach to promote social interaction skills for children with autism spectrum disorders. Proceedings of the 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, UK.10.1109/ROMAN.2014.6926242 ↗
90. Hirose, J., Hirokawa, M., and Suzuki, K. (2014, January 25–29). Robotic gaming companion to facilitate social interaction among children. Proceedings of the 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, UK.10.1109/ROMAN.2014.6926231 ↗
91. Mavadati, S.M., Feng, H., Gutierrez, A., and Mahoor, M.H. (2014, January 18–20). Comparing the gaze responses of children with autism and typically developed individuals in human-robot interaction. Proceedings of the 2014 14th IEEE-RAS International Conference on Humanoid Robots (Humanoids), Madrid, Spain.10.1109/HUMANOIDS.2014.7041510 ↗
92. Anzalone, S.M., Boucenna, S., Cohen, D., and Chetouani, M. (2014, January 3–6). Autism assessment through a small humanoid robot. Proceedings of the HRI: A Bridge between Robotics and Neuroscience, Workshop of the 9th ACM/IEEE International Conference on Human-Robot Interaction, Bielefeld, Germany.
93. How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D+ time) environment during a joint attention induction task with a robot10.1016/j.rasd.2014.03.002 ↗
94. Conti, D., Di Nuovo, S., Buono, S., Trubia, G., and Di Nuovo, A. (September, January 31). Use of robotics to stimulate imitation in children with Autism Spectrum Disorder: A pilot study in a clinical setting. Proceedings of the 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Kobe, Japan.10.1109/ROMAN.2015.7333589 ↗
95. A comparison of the effects of rhythm and robotic interventions on repetitive behaviors and affective states of children with Autism Spectrum Disorder (ASD)10.1016/j.rasd.2015.07.004 ↗
96. The effects of embodied rhythm and robotic interventions on the spontaneous and responsive verbal communication skills of children with Autism Spectrum Disorder (ASD): A further outcome of a pilot randomized controlled trial10.1016/j.rasd.2016.04.001 ↗
97. The effects of rhythm and robotic interventions on the imitation/praxis, interpersonal synchrony, and motor performance of children with autism spectrum disorder (ASD): A pilot randomized controlled trial
98. Mavadati, S.M., Feng, H., Salvador, M., Silver, S., Gutierrez, A., and Mahoor, M.H. (2016, January 26–31). Robot-based therapeutic protocol for training children with Autism. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.10.1109/ROMAN.2016.7745219 ↗
99. Chevalier, P., Martin, J.C., Isableu, B., Bazile, C., Iacob, D.O., and Tapus, A. (2016, January 26–31). Joint Attention using Human-Robot Interaction: Impact of sensory preferences of children with autism. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.10.1109/ROMAN.2016.7745218 ↗
100. Learning of social signatures through imitation game between a robot and a human partner10.1109/TAMD.2014.2319861 ↗