journal article·2021-02-13Open access

MR Images, Brain Lesions, and Deep Learning

Darwin Castillo, Vasudevan Lakshminarayanan, María José Rodríguez-Álvarez

Applied Sciences· Volume 11· Issue 4

Abstract

Medical brain image analysis is a necessary step in computer-assisted/computer-aided diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of white matter hyperintensities (WMHs) of brain magnetic resonance (MR) images, specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used bibliometric networks. Of a total of 140 documents, we selected 38 articles that deal with the main objectives of this study. Based on the analysis and discussion of the revised documents, there is constant growth in the research and development of new deep learning models to achieve the highest accuracy and reliability of the segmentation of ischemic and demyelinating lesions. Models with good performance metrics (e.g., Dice similarity coefficient, DSC: 0.99) were found; however, there is little practical application due to the use of small datasets and a lack of reproducibility. Therefore, the main conclusion is that there should be multidisciplinary research groups to overcome the gap between CAD developments and their deployment in the clinical environment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Brain Tumor Detection and Classification · AI in cancer detection · Radiomics and Machine Learning in Medical Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Departamento de Química y Ciencias Exactas, Sección Fisicoquímica y Matemáticas, Universidad Técnica Particular de Loja, San Cayetano Alto s/n, Loja 11-01-608, Ecuador

Theoretical and Experimental Epistemology Lab, School of Optometry and Vision Science, University of Waterloo, Waterloo, ON N2L3G1, Canada

Instituto de Instrumentación para Imagen Molecular (i3M) Universitat Politècnica de València—Consejo Superior de Investigaciones Científicas (CSIC), E-46022 Valencia, Spain

Departments of Physics, Electrical and Computer Engineering and Systems Design Engineering, University of Waterloo, Waterloo, ON N2L3G1, Canada

Funding

Agencia Estatal de Investigación-Gobierno de España

References (100+)

Show source-provided references
1. World Health Organization (2006). Neurological Disorders: Public Health Challenges, World Health Organization.
2. WHO (2020, May 10). The Top Ten Causes of Death. Available online: https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death.
3. The Application of Neuroimaging to Healthy and Diseased Brains: Present and Future10.3389/fneur.2017.00061 ↗
4. Artificial Intelligence Techniques for Automated Diagnosis of Neurological Disorders10.1159/000504292 ↗
5. Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: A review10.1016/j.artmed.2018.08.008 ↗
6. Magnetic resonance brain images algorithm to identify demyelinating and ischemic diseases
7. Demyelinating and ischemic brain diseases: Detection algorithm through regular magnetic resonance images10.1117/12.2274579 ↗
8. Neuroradiological evaluation of demyelinating disease10.1177/1756285613478870 ↗
9. Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions10.1007/s10278-017-9983-4 ↗
10. Yamanakkanavar, N., Choi, J.Y., and Lee, B. (2020). MRI Segmentation and Classification of Human Brain Using Deep Learning for Diagnosis of Alzheimer’s Disease: A Survey. Sensors, 20.10.3390/s20113243 ↗
11. Early Identification of Potentially Salvageable Tissue with MRI-Based Predictive Algorithms after Experimental Ischemic Stroke
12. The Bright, Artificial Intelligence-Augmented Future of Neuroimaging Reading10.3389/fneur.2017.00489 ↗
13. Editorial: Artificial Intelligence for Medical Image Analysis of Neuroimaging Data10.3389/fnins.2020.00480 ↗
14. Zhou, S.K., Rueckert, D., and Fichtinger, G. (2020). Chapter 16—Machine learning based imaging biomarkers in large scale population studies: A neuroimaging perspective. Handbook of Medical Image Computing and Computer Assisted Intervention, Academic Press.
15. Aminoff, M.J., and Daroff, R.B. (2014). Neuroimaging, Overview. Encyclopedia of the Neurological Sciences, Academic Press. [2nd ed.].
16. An overview of deep learning in medical imaging focusing on MRI10.1016/j.zemedi.2018.11.002 ↗
17. (2020, October 06). Magnetic Resonance Imaging (MRI) in Neurologic Disorders—Neurologic Disorders. Available online: https://www.msdmanuals.com/professional/neurologic-disorders/neurologic-tests-and-procedures/magnetic-resonance-imaging-mri-in-neurologic-disorders.
18. Magnetic resonance imaging and computed tomography in emergency assessment of patients with suspected acute stroke: A prospective comparison10.1016/S0140-6736(07)60151-2 ↗
19. Automated detection of white matter hyperintensities of all sizes in cerebral small vessel disease10.1118/1.4966029 ↗
20. Etiology-based classification of brain white matter hyperintensity on magnetic resonance imaging10.1117/1.JMI.2.1.014002 ↗
21. Computer aided detection and diagnosis methodology for brain stroke using adaptive neuro fuzzy inference system classifier10.1002/ima.22380 ↗
22. Demyelinating diseases10.1136/jcp.2005.031195 ↗
23. Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: Segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal10.1016/j.nicl.2012.10.003 ↗
24. Automatic detection of ischemic stroke using higher order spectra features in brain MRI images10.1016/j.cogsys.2019.05.005 ↗
25. Subudhi, A., Sahoo, S., Biswal, P., and Sabut, S. (2018). Segmentation and Classification of Ischemic Stroke Using Optimized Features in Brain MRI. Biomed. Eng. Appl. Basis Commun., 30.10.4015/S1016237218500114 ↗
26. ISLES 2015—A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI10.1016/j.media.2016.07.009 ↗
27. A Machine Learning Approach for Classifying Ischemic Stroke Onset Time From Imaging10.1109/TMI.2019.2901445 ↗
28. Automated segmentation and classification of brain stroke using expectation-maximization and random forest classifier10.1016/j.bbe.2019.04.004 ↗
29. Castillo, D.P., Samaniego, R.J., Jimenez, Y., Cuenca, L.A., Vivanco, O.A., Alvarez-Gomez, J.M., and Rodriguez-Alvarez, M.J. (November, January 26). Identifying Demyelinating and Ischemia Brain Diseases through Magnetic Resonance Images Processing. Proceedings of the IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC), Manchester, UK.
30. Segmentation of multiple sclerosis lesions in MR images: A review10.1007/s00234-011-0886-7 ↗
31. Malka, D., Vegerhof, A., Cohen, E., Rayhshtat, M., Libenson, A., Shalev, M.A., and Zalevsky, Z. (2017). Improved Diagnostic Process of Multiple Sclerosis Using Automated Detection and Selection Process in Magnetic Resonance Imaging. Appl. Sci., 7.10.3390/app7080831 ↗
32. Multiple sclerosis10.1016/S0140-6736(08)61620-7 ↗
33. Automated segmentation of acute stroke lesions using a data-driven anomaly detection on diffusion weighted MRI10.1016/j.jneumeth.2019.108575 ↗
34. Guidelines for the Early Management of Adults With Ischemic Stroke10.1161/STROKEAHA.107.181486 ↗
35. Ischemic Stroke Detection System with a Computer-Aided Diagnostic Ability Using an Unsupervised Feature Perception Enhancement Method10.1155/2014/947539 ↗
36. A Generative Probabilistic Model and Discriminative Extensions for Brain Lesion Segmentation—With Application to Tumor and Stroke10.1109/TMI.2015.2502596 ↗
37. Hemanth, D.J., Gupta, D., and Emilia Balas, V. (2019). Chapter 10—Classification of Myocardial Ischemia in Delayed Contrast Enhancement Using Machine Learning. Intelligent Data Analysis for Biomedical Applications, Academic Press.
38. Maier, O., Schröder, C., Forkert, N.D., Martinetz, T., and Handels, H. (2015). Classifiers for Ischemic Stroke Lesion Segmentation: A Comparison Study. PLoS ONE, 10.10.1371/journal.pone.0145118 ↗
39. Ranschaert, E.R., Morozov, S., and Algra, P.R. (2019). Neurological diseases. Artificial Intelligence in Medical Imaging: Opportunities, Applications and Risks, Springer International Publishing.10.1007/978-3-319-94878-2 ↗
40. Automatic Neuroimage Processing and Analysis in Stroke—A Systematic Review10.1109/RBME.2019.2934500 ↗
41. Machine Learning in Acute Ischemic Stroke Neuroimaging10.3389/fneur.2018.00945 ↗
42. Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks10.1016/j.nicl.2017.06.016 ↗
43. Joshi, S., and Gore, S. (2018, January 16–18). Ishemic Stroke Lesion Segmentation by Analyzing MRI Images Using Dilated and Transposed Convolutions in Convolutional Neural Networks. Proceedings of the 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), Pune, India.10.1109/ICCUBEA.2018.8697545 ↗
44. A New Approach for Brain Tumor Segmentation and Classification Based on Score Level Fusion Using Transfer Learning10.1007/s10916-019-1453-8 ↗
45. Radiomics: The process and the challenges10.1016/j.mri.2012.06.010 ↗
46. Radiomics: The facts and the challenges of image analysis10.1186/s41747-018-0068-z ↗
47. Structural neuroimaging as clinical predictor: A review of machine learning applications10.1016/j.nicl.2018.08.019 ↗
48. Evaluation of feature selection algorithms for classification in temporal lobe epilepsy based on MR images10.1117/12.2266346 ↗
49. Medical Image Analysis using Convolutional Neural Networks: A Review10.1007/s10916-018-1088-1 ↗
50. Segmentation of glioma tumors in brain using deep convolutional neural network10.1016/j.neucom.2017.12.032 ↗
51. Nadeem, M.W., Al Ghamdi, M.A., Hussain, M., Khan, M.A., Khan, K.M., AlMotiri, S.H., and Butt, S.A. (2020). Brain Tumor Analysis Empowered with Deep Learning: A Review, Taxonomy, and Future Challenges. Brain Sci., 10.10.3390/brainsci10020118 ↗
52. Five Steps to Conducting a Systematic Review10.1177/014107680309600304 ↗
53. Botto-Tobar, M., Pizarro, G., Zúñiga-Prieto, M., D’Armas, M., and Zúñiga Sánchez, M. (2019). Gesture-Based Children Computer Interaction for Inclusive Education: A Systematic Literature Review. Proceedings of the Technology Trends, Springer International Publishing.10.1007/978-3-030-05532-5 ↗
54. Torres-Carrion, P.V., Gonzalez-Gonzalez, C.S., Aciar, S., and Rodriguez-Morales, G. (2018, January 17–20). Methodology for Systematic Literature Review Applied to Engineering and Education. Proceedings of the 2018 IEEE Global Engineering Education Conference (EDUCON), Tenerife, Spain.10.1109/EDUCON.2018.8363388 ↗
55. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., and The PRISMA Group (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med., 6.10.1371/journal.pmed.1000097 ↗
56. University–industry cooperation: A systematic literature review and research agenda10.1093/scipol/scy003 ↗
57. Ding, Y., Rousseau, R., and Wolfram, D. (2014). Visualizing Bibliometric Networks. Measuring Scholarly Impact: Methods and Practice, Springer International Publishing.10.1007/978-3-319-10377-8 ↗
58. A unified approach to mapping and clustering of bibliometric networks
59. Constructing bibliometric networks: A comparison between full and fractional counting
60. (2020, December 22). Scopus. Available online: https://www.scopus.com/.
61. National Library of Medicine (2020, June 26). PubMed.gov, Available online: https://pubmed.ncbi.nlm.nih.gov/.
62. (2020, December 22). Document Search—Web of Science Core Collection. Available online: https://www.webofscience.com/wos/woscc/basic-search.
63. (2020, December 22). ScienceDirect.Com/Science, Health and Medical Journals, Full Text Articles and Books. Available online: https://www.sciencedirect.com/.
64. (2020, December 22). IEEE Xplore. Available online: https://ieeexplore.ieee.org/Xplore/home.jsp.
65. Google (2010, December 02). Google Scholar. Available online: http://scholar.google.com.
66. Big Data Approaches to Phenotyping Acute Ischemic Stroke Using Automated Lesion Segmentation of Multi-Center Magnetic Resonance Imaging Data10.1161/STROKEAHA.119.025373 ↗
67. White matter hyperintensity burden in acute stroke patients differs by ischemic stroke subtype10.1212/WNL.0000000000009728 ↗
68. Deep learning in medical image analysis: A third eye for doctors10.1016/j.jormas.2019.06.002 ↗
69. van Eck, N.J., and Waltman, L. (2013). VOSviewer Manual, University Leiden.
70. Aghaei-Chadegani, A., Salehi, H., Yunus, M., Farhadi, H., Fooladi, M., Farhadi, M., and Ale Ebrahim, N. (2013). A Comparison between Two Main Academic Literature Collections: Web of Science and Scopus Databases, Social Science Research Network.10.5539/ass.v9n5p18 ↗
71. How to normalize cooccurrence data? An analysis of some well-known similarity measures10.1002/asi.21075 ↗
72. Quantitative prediction of acute ischemic tissue fate using support vector machine10.1016/j.brainres.2011.05.066 ↗
73. Rajinikanth, V., Thanaraj, K.P., Satapathy, S.C., Fernandes, S.L., and Dey, N. Shannon’s Entropy and Watershed Algorithm Based Technique to Inspect Ischemic Stroke Wound. Proceedings of the Smart Modelling for Engineering Systems.
74. Automatic Segmentation of Acute Ischemic Stroke From DWI Using 3-D Fully Convolutional DenseNets10.1109/TMI.2018.2821244 ↗
75. ISLES 2016 and 2017-Benchmarking Ischemic Stroke Lesion Outcome Prediction Based on Multispectral MRI10.3389/fneur.2018.00679 ↗
76. Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation10.1016/j.media.2016.10.004 ↗
77. Segmentation of Ischemic Stroke Lesion in Brain MRI Based on Social Group Optimization and Fuzzy-Tsallis Entropy10.1007/s13369-017-3053-6 ↗
78. Prediction of Tissue Outcome and Assessment of Treatment Effect in Acute Ischemic Stroke Using Deep Learning10.1161/STROKEAHA.117.019740 ↗
79. Enhancing interpretability of automatically extracted machine learning features: Application to a RBM-Random Forest system on brain lesion segmentation10.1016/j.media.2017.12.009 ↗
80. Bagher-Ebadian, H., Jafari-Khouzani, K., Mitsias, P.D., Lu, M., Soltanian-Zadeh, H., Chopp, M., and Ewing, J.R. (2011). Predicting Final Extent of Ischemic Infarction Using Artificial Neural Network Analysis of Multi-Parametric MRI in Patients with Stroke. PLoS ONE, 6.10.1371/journal.pone.0022626 ↗
81. McCarthy, J., Minsky, M.L., Rochester, N., and Shannon, C.E. (2006). A proposal for the dartmouth summer research project on artificial intelligence, August 31, 1955. AI Mag., 27.
82. Deep Learning for Retinal Analysis
83. What is the Optimal Attribution Method for Explainable Ophthalmic Disease Classification?10.1007/978-3-030-63419-3_3 ↗
84. Singh, A., Sengupta, S., and Lakshminarayanan, V. (2020). Explainable Deep Learning Models in Medical Image Analysis. J. Imaging, 6.10.3390/jimaging6060052 ↗
85. Ophthalmic diagnosis using deep learning with fundus images—A critical review10.1016/j.artmed.2019.101758 ↗
86. El-Baz, A., and Suri, J. (2021). Deep Learning for Ophthalmology using Optical Coherence Tomography. State of the Art in Neural Networks and Their Applications, Academic Press.
87. Jiménez, Y., and Castillo, D. (2020). Diagnosis of Retinal Diseases: New Results Using Deep Learning. Libro de Actas I Congreso de Matemática Aplicada y Educativa (CMAE), Loja, Ecuador, 16-18 January 2020, Universidad Técnica Particular de Loja.
88. The history of artificial intelligence in medicine10.1016/j.gie.2020.06.040 ↗
89. (2020, December 17). Is Artificial Intelligence Going to Replace Dermatologists?. Available online: https://www.mdedge.com/dermatology/article/215099/practice-management/artificial-intelligence-going-replace-dermatologists.
90. Strengths, Weaknesses, Opportunities, and Threats Analysis of Artificial Intelligence and Machine Learning Applications in Radiology10.1016/j.jacr.2019.05.047 ↗
91. Machine Learning in Radiology: Applications Beyond Image Interpretation10.1016/j.jacr.2017.09.044 ↗
92. Deep into the Brain: Artificial Intelligence in Stroke Imaging10.5853/jos.2017.02054 ↗
93. Goodfellow, I., Bengio, Y., and Courville, A. (2020). Deep Learning, MIT Press.
94. (2020, November 04). Classification of Abnormalities in Brain MRI Images Using GLCM, PCA and SVM. Available online: http://journaldatabase.info/articles/classification_abnormalities_brain_mri.html.
95. An Mr Brain Images Classifier via Principal Component Analysis and Kernel Support Vector Machine10.2528/PIER12061410 ↗
96. Using Support Vector Machine to identify imaging biomarkers of neurological and psychiatric disease: A critical review10.1016/j.neubiorev.2012.01.004 ↗
97. (2020, November 24). KNN Classification Using Scikit-Learn. Available online: https://www.datacamp.com/community/tutorials/k-nearest-neighbor-classification-scikit-learn.
98. Rajini, N.H., and Bhavani, R. (2011, January 3–5). Classification of MRI brain images using k-nearest neighbor and artificial neural network. Proceedings of the 2011 International Conference on Recent Trends in Information Technology (ICRTIT), Chennai, India.10.1109/ICRTIT.2011.5972341 ↗
99. MRI Brain Abnormalities Segmentation using K-Nearest Neighbors(k-NN)
100. Rashed, R., Boudrioua, A., and Lakshminarayanan, V. (2017). Ibn-Al-Haytham: Founder of Physiological Optics, CRC Press. Light Based Science: Technology and Sustainable Development.10.1201/9781315155081 ↗