journal article·2023-02-10Open access

Applications of Deep Learning to Neurodevelopment in Pediatric Imaging: Achievements and Challenges

Mengjiao Hu, Cosimo Nardi, Haihong Zhang, Kai-Keng Ang

Applied Sciences· Volume 13· Issue 4

Abstract

Deep learning has achieved remarkable progress, particularly in neuroimaging analysis. Deep learning applications have also been extended from adult to pediatric medical images, and thus, this paper aims to present a systematic review of this recent research. We first introduce the commonly used deep learning methods and architectures in neuroimaging, such as convolutional neural networks, auto-encoders, and generative adversarial networks. A non-exhaustive list of commonly used publicly available pediatric neuroimaging datasets and repositories are included, followed by a categorical review of recent works in pediatric MRI-based deep learning studies in the past five years. These works are categorized into recognizing neurodevelopmental disorders, identifying brain and tissue structures, estimating brain age/maturity, predicting neurodevelopment outcomes, and optimizing MRI brain imaging and analysis. Finally, we also discuss the recent achievements and challenges on these applications of deep learning to pediatric neuroimaging.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Neonatal and fetal brain pathology · Fetal and Pediatric Neurological Disorders · Congenital Heart Disease Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore 138632, Singapore

Department of Experimental and Clinical Biomedical Sciences, University of Florence—Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy

School of Computer Science and Engineering, Nanyang Technological University, Singapore 639798, Singapore

Funding

Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR) · A*STAR Strategic Programme Funds

References (100+)

Show source-provided references
1. Machine learning: Trends, perspectives, and prospects10.1126/science.aaa8415 ↗
2. A survey on deep learning applied to medical images: From simple artificial neural networks to generative models10.1007/s00521-022-07953-4 ↗
3. Deep learning10.1038/nature14539 ↗
4. Recent advances in convolutional neural networks10.1016/j.patcog.2017.10.013 ↗
5. Artificial intelligence in radiology10.1038/s41568-018-0016-5 ↗
6. Machine learning in breast MRI10.1002/jmri.26852 ↗
7. Machine learning methods for diagnosing autism spectrum disorder and attention-deficit/hyperactivity disorder using functional and structural MRI: A survey10.3389/fninf.2020.575999 ↗
8. Zhang, Z., Li, G., Xu, Y., and Tang, X. (2021). Application of artificial intelligence in the MRI classification task of human brain neurological and psychiatric diseases: A scoping review. Diagnostics, 11.10.3390/diagnostics11081402 ↗
9. Advances in MRI methodology10.1016/bs.irn.2018.08.008 ↗
10. Principles of nuclear magnetic resonance imaging10.1148/radiology.143.1.7038763 ↗
11. Basic principles of magnetic resonance imaging10.1016/S0033-0620(99)70014-9 ↗
12. Huettel, S.A., Song, A.W., and McCarthy, G. (2004). Functional Magnetic Resonance Imaging, Sinauer Associates Sunderland.
13. Principles of diffusion tensor imaging and its applications to basic neuroscience research10.1016/j.neuron.2006.08.012 ↗
14. Segmentation techniques of brain arteriovenous malformations for 3D visualization: A systematic review10.1007/s11547-022-01567-5 ↗
15. AI applications to medical images: From machine learning to deep learning10.1016/j.ejmp.2021.02.006 ↗
16. Deep learning for neuroimaging-based diagnosis and rehabilitation of autism spectrum disorder: A review10.1016/j.compbiomed.2021.104949 ↗
17. Machine learning for autism spectrum disorder diagnosis using structural magnetic resonance imaging: Promising but challenging10.3389/fninf.2022.949926 ↗
18. Wang, S., Di, J., Wang, D., Dai, X., Hua, Y., Gao, X., Zheng, A., and Gao, J. (2022). State-of-the-Art Review of Artificial Neural Networks to Predict, Characterize and Optimize Pharmaceutical Formulation. Pharmaceutics, 14.10.3390/pharmaceutics14010183 ↗
19. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
20. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
21. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
22. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
23. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
24. Deepvolume: Brain structure and spatial connection-aware network for brain mri super-resolution10.1109/TCYB.2019.2933633 ↗
25. Automatic Segmentation of Diffuse White Matter Abnormality on T2-weighted Brain MR Images Using Deep Learning in Very Preterm Infants10.1148/ryai.2021200166 ↗
26. Machine learning applications on neuroimaging for diagnosis and prognosis of epilepsy: A review10.1016/j.jneumeth.2021.109441 ↗
27. Elbattah, M., Loughnane, C., Guérin, J.L., Carette, R., Cilia, F., and Dequen, G. (2021). Variational Autoencoder for Image-Based Augmentation of Eye-Tracking Data. J. Imaging, 7.10.3390/jimaging7050083 ↗
28. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., and Weinberger, K.Q. (2014). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc.
29. Recent progress on generative adversarial networks (GANs): A survey10.1109/ACCESS.2019.2905015 ↗
30. Generative adversarial network in medical imaging: A review10.1016/j.media.2019.101552 ↗
31. The autism brain imaging data exchange: Towards a large-scale evaluation of the intrinsic brain architecture in autism10.1038/mp.2013.78 ↗
32. Enhancing studies of the connectome in autism using the autism brain imaging data exchange II10.1038/sdata.2017.10 ↗
33. (2022, December 15). IMPAC—Imaging-Psychiatry Challenge: Predicting Autism. Available online: https://paris-saclay-cds.github.io/autism_challenge/.
34. The ADHD-200 consortium: A model to advance the translational potential of neuroimaging in clinical neuroscience10.3389/fnsys.2012.00062 ↗
35. Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., and Landray, M. (2015). UK biobank: An open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med., 12.10.1371/journal.pmed.1001779 ↗
36. National Database for Autism Research (NDAR): Big Data Opportunities for Health Services Research and Health Technology Assessment10.1007/s40273-015-0331-6 ↗
37. Toward open sharing of task-based fMRI data: The OpenfMRI project10.3389/fninf.2013.00012 ↗
38. A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM)10.1098/rstb.2001.0915 ↗
39. Standardizing the intrinsic brain: Towards robust measurement of inter-individual variation in 1000 functional connectomes10.1016/j.neuroimage.2013.04.081 ↗
40. The adolescent brain cognitive development (ABCD) study: Imaging acquisition across 21 sites10.1016/j.dcn.2018.03.001 ↗
41. The ENIGMA Consortium: Large-scale collaborative analyses of neuroimaging and genetic data10.1007/s11682-013-9269-5 ↗
42. Neuroimaging of the Philadelphia neurodevelopmental cohort10.1016/j.neuroimage.2013.07.064 ↗
43. An open resource for transdiagnostic research in pediatric mental health and learning disorders10.1038/sdata.2017.181 ↗
44. The Human Connectome Project: A data acquisition perspective10.1016/j.neuroimage.2012.02.018 ↗
45. The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development10.1016/j.neuroimage.2018.03.049 ↗
46. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement10.7326/0003-4819-151-4-200908180-00135 ↗
47. PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation10.7326/M18-0850 ↗
48. Sterne, J.A., Hernán, M.A., Reeves, B.C., Savović, J., Berkman, N.D., Viswanathan, M., Henry, D., Altman, D.G., Ansari, M.T., and Boutron, I. (2016). ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ, 355.10.1136/bmj.i4919 ↗
49. Diagnostic and statistical manual of mental disorders
50. Neurodevelopmental disorders-the history and future of a diagnostic concept10.31887/DCNS.2020.22.1/macrocq ↗
51. Dvornek, N.C., Ventola, P., and Duncan, J.S. (2018, January 4–7). Combining phenotypic and resting-state fMRI data for autism classification with recurrent neural networks. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.10.1109/ISBI.2018.8363676 ↗
52. Computer-aided diagnosis of school-aged children with ASD using full frequency bands and enhanced SAE: A multi-institution study
53. Diagnosis of autism spectrum disorders in young children based on resting-state functional magnetic resonance imaging data using convolutional neural networks10.1007/s10278-019-00196-1 ↗
54. A novel transfer learning approach to enhance deep neural network classification of brain functional connectomes10.3389/fnins.2018.00491 ↗
55. Ensemble deep learning on large, mixed-site fMRI datasets in autism and other tasks10.1142/S0129065720500124 ↗
56. Defining ADHD symptom persistence in adulthood: Optimizing sensitivity and specificity10.1111/jcpp.12620 ↗
57. A computational framework for the detection of subcortical brain dysmaturation in neonatal MRI using 3D Convolutional Neural Networks10.1016/j.neuroimage.2018.05.049 ↗
58. Dyslexia detection using 3D convolutional neural networks and functional magnetic resonance imaging10.1016/j.cmpb.2020.105726 ↗
59. Deep learning-based lesion segmentation in paediatric epilepsy
60. Identifying epilepsy based on deep learning using DKI images10.3389/fnhum.2020.590815 ↗
61. Three dimensional convolutional neural network-based classification of conduct disorder with structural MRI10.1007/s11682-019-00186-5 ↗
62. Multimodal Ensemble Deep Learning to Predict Disruptive Behavior Disorders in Children10.3389/fninf.2021.742807 ↗
63. Yang, J., Lei, D., Qin, K., Pinaya, W.H., Suo, X., Li, W., Li, L., Kemp, G.J., and Gong, Q. (2021). Using deep learning to classify pediatric posttraumatic stress disorder at the individual level. BMC Psychiatry, 21.10.1186/s12888-021-03503-9 ↗
64. Jiang, D., Hu, Z., Zhao, C., Zhao, X., Yang, J., Zhu, Y., Liao, J., Liang, D., and Wang, H. (2022, January 11–15). Identification of Children’s Tuberous Sclerosis Complex with Multiple-contrast MRI and 3D Convolutional Network. Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Scotland, UK.10.1109/EMBC48229.2022.9871037 ↗
65. 3D deep neural network to automatically identify TSC structural brain pathology based on MRI
66. Afshar, P., Mohammadi, A., and Plataniotis, K.N. (2018, January 7–10). Brain tumor type classification via capsule networks. Proceedings of the 2018 25th IEEE international conference on image processing (ICIP), Athens, Greece.10.1109/ICIP.2018.8451379 ↗
67. Novel deep learning network analysis of electrical stimulation mapping-driven diffusion MRI tractography to improve preoperative evaluation of pediatric epilepsy10.1109/TBME.2020.2977531 ↗
68. Objective detection of eloquent axonal pathways to minimize postoperative deficits in pediatric epilepsy surgery using diffusion tractography and convolutional neural networks10.1109/TMI.2019.2902073 ↗
69. Large-scale brain functional network integration for discrimination of autism using a 3-D deep learning model10.3389/fnhum.2021.687288 ↗
70. Wu, M., Shen, X., Lai, C., Zheng, W., Li, Y., Shangguan, Z., Yan, C., Liu, T., and Wu, D. (2021). Detecting neonatal acute bilirubin encephalopathy based on T1-weighted MRI images and learning-based approaches. BMC Med. Imaging, 21.10.1186/s12880-021-00634-z ↗
71. Sánchez Fernández, I., Yang, E., Calvachi, P., Amengual-Gual, M., Wu, J.Y., Krueger, D., Northrup, H., Bebin, M.E., Sahin, M., and Yu, K.H. (2020). Deep learning in rare disease. Detection of tubers in tuberous sclerosis complex. PLoS ONE, 15.10.1371/journal.pone.0232376 ↗
72. Deep learning for pediatric posterior fossa tumor detection and classification: A multi-institutional study
73. Uncovering Brain Differences in Preschoolers and Young Adolescents with Autism Spectrum Disorder Using Deep Learning10.1142/S0129065722500447 ↗
74. A robust DWT–CNN-based CAD system for early diagnosis of autism using task-based fMRI10.1002/mp.14692 ↗
75. Reproducible neuroimaging features for diagnosis of autism spectrum disorder with machine learning10.1038/s41598-022-06459-2 ↗
76. Single-participant structural similarity matrices lead to greater accuracy in classification of participants than function in autism in MRI10.1186/s13229-021-00439-5 ↗
77. ConCeptCNN: A novel multi-filter convolutional neural network for the prediction of neurodevelopmental disorders using brain connectome10.1002/mp.15545 ↗
78. Evidence for similar structural brain anomalies in youth and adult attention-deficit/hyperactivity disorder: A machine learning analysis10.1038/s41398-021-01201-4 ↗
79. Diagnosing autism spectrum disorder from brain resting-state functional connectivity patterns using a deep neural network with a novel feature selection method10.3389/fnins.2017.00460 ↗
80. Li, X., Dvornek, N.C., Zhuang, J., Ventola, P., and Duncan, J.S. (2018, January 16–20). Brain biomarker interpretation in ASD using deep learning and fMRI. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Granada, Spain.10.1007/978-3-030-00931-1_24 ↗
81. Combination of rs-fMRI and sMRI data to discriminate autism spectrum disorders in young children using deep belief network10.1007/s10278-018-0093-8 ↗
82. Exploring the structural and strategic bases of autism spectrum disorders with deep learning10.1109/ACCESS.2020.3016734 ↗
83. Functional magnetic resonance imaging for autism spectrum disorder detection using deep learning10.11113/jurnalteknologi.v83.16389 ↗
84. BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment10.1016/j.neuroimage.2016.09.046 ↗
85. Unified framework for early stage status prediction of autism based on infant structural magnetic resonance imaging10.1002/aur.2626 ↗
86. Diagnosing autism spectrum disorder in children using conventional MRI and apparent diffusion coefficient based deep learning algorithms10.1007/s00330-021-08239-4 ↗
87. Wang, T., and Kamata, S.I. (2018, January 22–25). Classification of structural MRI images in Adhd using 3D fractal dimension complexity map. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.10.1109/ICIP.2019.8802930 ↗
88. DeepFMRI: End-to-end deep learning for functional connectivity and classification of ADHD using fMRI10.1016/j.jneumeth.2019.108506 ↗
89. ADHD classification using auto-encoding neural network and binary hypothesis testing10.1016/j.artmed.2021.102209 ↗
90. ADHD identification and its interpretation of functional connectivity using deep self-attention factorization10.1016/j.knosys.2022.109082 ↗
91. Wang, D., Hong, D., and Wu, Q. (2022). Attention Deficit Hyperactivity Disorder Classification Based on Deep Learning. IEEE/Acm Trans. Comput. Biol. Bioinform., 1.10.1109/TCBB.2022.3170527 ↗
92. A Class Activation Map-Based Interpretable Transfer Learning Model for Automated Detection of ADHD from fMRI Data
93. A fully convolutional neural network for explainable classification of attention deficit hyperactivity disorder
94. Attallah, O., Sharkas, M.A., and Gadelkarim, H. (2020). Deep learning techniques for automatic detection of embryonic neurodevelopmental disorders. Diagnostics, 10.10.3390/diagnostics10010027 ↗
95. Classification of pediatric posterior fossa tumors using convolutional neural network and tabular data10.1109/ACCESS.2021.3085771 ↗
96. Robust deep learning classification of adamantinomatous craniopharyngioma from limited preoperative radiographic images10.1038/s41598-020-73278-8 ↗
97. Segmenting pediatric optic pathway gliomas from MRI using deep learning10.1016/j.compbiomed.2022.105237 ↗
98. FetalGAN: Automated Segmentation of Fetal Functional Brain MRI Using Deep Generative Adversarial Learning and Multi-Scale 3D U-Net
99. Intelligent labeling based on fisher information for medical image segmentation using deep learning10.1109/TMI.2019.2907805 ↗
100. Deep learning-based automatic tumor burden assessment of pediatric high-grade gliomas, medulloblastomas, and other leptomeningeal seeding tumors10.1093/neuonc/noab151 ↗