journal article·2023-04-12Open access

Deep Learning Algorithms to Identify Autism Spectrum Disorder in Children-Based Facial Landmarks

Hasan Alkahtani, Theyazn H. H. Aldhyani, Mohammed Y. Alzahrani

Applied Sciences· Volume 13· Issue 8

Abstract

People with autistic spectrum disorders (ASDs) have difficulty recognizing and engaging with others. The symptoms of ASD may occur in a wide range of situations. There are numerous different types of functions for people with an ASD. Although it may be possible to reduce the symptoms of ASD and enhance the quality of life with appropriate treatment and support, there is no cure. Developing expert systems for identifying ASD based on the facial landmarks of children is the main contribution for improvements in the healthcare system in Saudi Arabia for detecting ASD at an early stage. However, deep learning algorithms have provided outstanding performances in a variety of pattern-recognition studies. The use of techniques based on convolutional neural networks (CNNs) has been proposed by several scholars to use in investigations of ASD. At present, there is no diagnostic test available for ASD, making this diagnosis challenging. Clinicians focus on a patient’s behavior and developmental history. Therefore, using the facial landmarks of children has become very important for detecting ASDs as the face is thought to be a reflection of the brain; it has the potential to be used as a diagnostic biomarker, in addition to being an easy-to-use and practical tool for the early detection of ASDs. This study uses a variety of transfer learning approaches observed in deep CNNs to recognize autistic children based on facial landmark detection. An empirical study is conducted to discover the ideal settings for the optimizer and hyperparameters in the CNN model so that its prediction accuracy can be improved. A transfer learning approach, such as MobileNetV2 and hybrid VGG19, is used with different machine learning programs, such as logistic regression, a linear support vector machine (linear SVC), random forest, decision tree, gradient boosting, MLPClassifier, and K-nearest neighbors. The deep learning models are examined using a standard research dataset from Kaggle, which contains 2940 images of autistic and non-autistic children. The MobileNetV2 model achieved an accuracy of 92% on the test set. The results of the proposed research indicate that MobileNetV2 transfer learning strategies are better than those developed in existing systems. The updated version of our model has the potential to assist physicians in verifying the accuracy of their first screening for ASDs in child patients.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autism Spectrum Disorder Research · COVID-19 diagnosis using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

King Salman Center for Disability Research, Riyadh 11614, Saudi Arabia

College of Computer Science and Information Technology, King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia

Applied College in Abqaiq, King Faisal University, P.O. Box 400, Al-Ahsa 31982, Saudi Arabia

Department of Computer Sciences and Information Technology, Albaha University, Al-Baha 65799, Saudi Arabia

Funding

King Salman center for disability research

References (46)

Show source-provided references
1. Autism Spectrum Disorder10.1016/S0140-6736(18)31129-2 ↗
2. Using 2D Video-Based Pose Estimation for Automated Prediction of Autism Spectrum Disorders in Young Children10.1038/s41598-021-94378-z ↗
3. A Phase III Study of Bumetanide Oral Liquid Formulation for the Treatment of Children and Adolescents Aged between 7 and 17 Years with Autism Spectrum Disorder (SIGN 1 Trial): Participant Baseline Characteristics
4. To Reduce the Average Age of Autism Diagnosis, Screen Preschoolers in Primary Care10.1177/1362361320968974 ↗
5. Goh, K.L., Morris, S., Rosalie, S., Foster, C., Falkmer, T., and Tan, T. (2016, January 20–25). Typically Developed Adults and Adults with Autism Spectrum Disorder Classification Using Centre of Pressure Measurements. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7471794 ↗
6. What is autism
7. A Randomized Clinical Trial Comparing Two Treatment Strategies, Evaluating the Meaningfulness of HAM-D Rating Scale in Patients With Major Depressive Disorder10.3389/fpsyt.2022.873693 ↗
8. Visual Social Attention in Autism Spectrum Disorder: Insights from Eye Tracking Studies10.1016/j.neubiorev.2014.03.013 ↗
9. Kanhirakadavath, M.R., and Chandran, M.S.M. (2022). Investigation of Eye-Tracking Scan Path as a Biomarker for Autism Screening Using Machine Learning Algorithms. Diagnostics, 12.10.3390/diagnostics12020518 ↗
10. Mujeeb Rahman, K.K., and Subashini, M.M. (2022). Identification of Autism in Children Using Static Facial Features and Deep Neural Networks. Brain Sci., 12.10.3390/brainsci12010094 ↗
11. Aldhyani, T.H.H., Verma, A., Al-Adhaileh, M.H., and Koundal, D. (2022). Multi-Class Skin Lesion Classification Using a Lightweight Dynamic Kernel Deep-Learning-Based Convolutional Neural Network. Diagnostics, 12.10.3390/diagnostics12092048 ↗
12. Statistical Analysis of the Activation Area of Fusiform Gyrus of Human Brain to Explore Autism
13. Aldhyani, T.H.H., Nair, R., Alzain, E., Alkahtani, H., and Koundal, D. (2022). Deep Learning Model for the Detection of Real Time Breast Cancer Images Using Improved Dilation-Based Method. Diagnostics, 12.10.3390/diagnostics12102505 ↗
14. Temporal Voice Areas Exist in Autism Spectrum Disorder but Are Dysfunctional for Voice Identity Recognition10.1093/scan/nsw089 ↗
15. Bunke, H., Kandel, A., and Last, M. (2008). Applied Pattern Recognition, Springer.10.1007/978-3-540-76831-9 ↗
16. Facial Image Processing10.1186/1687-5281-2007-070872 ↗
17. Yolcu, G., Oztel, I., Kazan, S., Oz, C., Palaniappan, K., Lever, T.E., and Bunyak, F. (2017, January 13–16). Deep Learning-Based Facial Expression Recognition for Monitoring Neurological Disorders. Proceedings of the 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Kansas City, MO, USA.10.1109/BIBM.2017.8217907 ↗
18. Facial Expression Recognition for Monitoring Neurological Disorders Based on Convolutional Neural Network10.1007/s11042-019-07959-6 ↗
19. Haque, M.I.U., and Valles, D. (2018, January 1–3). A Facial Expression Recognition Approach Using DCNN for Autistic Children to Identify Emotions. Proceedings of the 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), Vancouver, BC, Canada.10.1109/IEMCON.2018.8614802 ↗
20. Rudovic, O., Utsumi, Y., Lee, J., Hernandez, J., Ferrer, E.C., Schuller, B., and Picard, R.W. (2018, January 1–5). CultureNet: A Deep Learning Approach for Engagement Intensity Estimation from Face Images of Children with Autism. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594177 ↗
21. Satu, M.S., Azad, M.S., Haque, M.F., Imtiaz, S.K., Akter, T., Barua, L., Rashid, M., Soron, T.R., and Al Mamun, K.A. (2019, January 17–19). Prottoy: A Smart Phone Based Mobile Application to Detect Autism of Children in Bangladesh. Proceedings of the 2019 4th International Conference on Electrical Information and Communication Technology (EICT), Khulna, Bangladesh.10.1109/EICT48899.2019.9068815 ↗
22. Akter, T., Ali, M.H., Khan, M.I., Satu, M.S., and Moni, M.A. (2021, January 5–7). Machine Learning Model to Predict Autism Investigating Eye-Tracking Dataset. Proceedings of the 2021 2nd International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST), Online.10.1109/ICREST51555.2021.9331152 ↗
23. Akter, T., Ali, M.H., Khan, M.I., Satu, M.S., Uddin, M., Alyami, S.A., Ali, S., Azad, A., and Moni, M.A. (2021). Improved Transfer-Learning-Based Facial Recognition Framework to Detect Autistic Children at an Early Stage. Brain Sci., 11.10.3390/brainsci11060734 ↗
24. A New Computational Intelligence Approach to Detect Autistic Features for Autism Screening10.1016/j.ijmedinf.2018.06.009 ↗
25. Omar, K.S., Mondal, P., Khan, N.S., Rizvi, M.R.K., and Islam, M.N. (2019, January 7–9). A Machine Learning Approach to Predict Autism Spectrum Disorder. Proceedings of the 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE), Bazar, Bangladesh.10.1109/ECACE.2019.8679454 ↗
26. Improved Autistic Spectrum Disorder Estimation Using Cfs Subset with Greedy Stepwise Feature Selection Technique
27. Satu, M.S., Sathi, F.F., Arifen, M.S., Ali, M.H., and Moni, M.A. (2021, January 10–12). Early Detection of Autism by Extracting Features: A Case Study in Bangladesh. Proceedings of the 2019 International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST), Dhaka, Bangladesh.10.1109/ICREST.2019.8644357 ↗
28. Autism Spectrum Disorder Detection with Machine Learning Methods
29. A Machine Learning Autism Classification Based on Logistic Regression Analysis10.1007/s13755-019-0073-5 ↗
30. Machine Learning-Based Models for Early Stage Detection of Autism Spectrum Disorders10.1109/ACCESS.2019.2952609 ↗
31. Hossain, M.D., Kabir, M.A., Anwar, A., and Islam, M.Z. (2020). Detecting Autism Spectrum Disorder using Machine Learning. arXiv.10.1007/s13755-021-00145-9 ↗
32. Large-Scale Brain Functional Network Integration for Discrimination of Autism Using a 3-D Deep Learning Model10.3389/fnhum.2021.687288 ↗
33. Ahsan, M.M., Alam, E.T., Trafalis, T., and Huebner, P. (2020). Deep Mlp-Cnn Model Using Mixed-Data to Distinguish between COVID-19 and Non-COVID-19 Patients. Symmetry, 12.10.3390/sym12091526 ↗
34. COVID-19 Symptoms Detection Based on Nasnetmobile with Explainable AI Using Various Imaging Modalities10.3390/make2040027 ↗
35. Detecting SARS-CoV-2 from Chest X-Ray Using Artificial Intelligence10.1109/ACCESS.2021.3061621 ↗
36. Ahsan, M.M., Mahmud, M., Saha, P.K., Gupta, K.D., and Siddique, Z. (2021). Effect of Data Scaling Methods on Machine Learning Algorithms and Model Performance. Technologies, 9.10.3390/technologies9030052 ↗
37. Ahsan, M.M., Nazim, R., Siddique, Z., and Huebner, P. (2021). Detection of COVID-19 Patients from CT Scan and Chest X-Ray Data Using Modified MobileNetV2 and LIME. Healthcare, 9.10.3390/healthcare9091099 ↗
38. Ahsan, M.M., Luna, S.A., and Siddique, Z. (2022). Machine-Learning-Based Disease Diagnosis: A Comprehensive Review. Healthcare, 10.10.3390/healthcare10030541 ↗
39. Machine Learning-Based Heart Disease Diagnosis: A Systematic Literature Review10.1016/j.artmed.2022.102289 ↗
40. Haque, R., Islam, N., Islam, M., and Ahsan, M.M. (2022). A Comparative Analysis on Suicidal Ideation Detection Using NLP, Machine, and Deep Learning. Technologies, 10.10.3390/technologies10030057 ↗
41. Pham, H., Jones, M.A., Gai, T., Islam, W., Danala, G., Jo, J., and Zheng, B. (2022, January 4). Identifying an optimal machine learning generated image marker to predict survival of gastric cancer patients. Proceedings of the Medical Imaging 2022: Computer-Aided Diagnosis, San Diego, CA, USA.10.1117/12.2611788 ↗
42. Realizing transfer learning for updating deep learning models of spectral data to be used in new scenarios10.1016/j.chemolab.2021.104283 ↗
43. Khosla, Y., Ramachandra, P., and Chaitra, N. (2021, January 16–18). Detection of autistic individuals using facial images and deep learning. Proceedings of the 2021 IEEE International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS), Bangalore, India.10.1109/CSITSS54238.2021.9683205 ↗
44. MAFONN-EP: A Minimal Angular Feature Oriented Neural Network based Emotion Prediction system in image processing
45. Psychiatric Hospitalization among Children with Autism Spectrum Disorders10.1007/s10803-007-0481-2 ↗
46. Classification and Detection of Autism Spectrum Disorder Based on Deep Learning Algorithms10.1155/2022/8709145 ↗