journal article·2022-06-02Open access

An Effective Approach to Detect and Identify Brain Tumors Using Transfer Learning

Naeem Ullah, Javed Ali Khan, Mohammad Sohail Khan, Wahab Khan, Izaz Hassan, Marwa Obayya, Noha Negm, Ahmed S. Salama

Applied Sciences· Volume 12· Issue 11

Abstract

Brain tumors are considered one of the most serious, prominent and life-threatening diseases globally. Brain tumors cause thousands of deaths every year around the globe because of the rapid growth of tumor cells. Therefore, timely analysis and automatic detection of brain tumors are required to save the lives of thousands of people around the globe. Recently, deep transfer learning (TL) approaches are most widely used to detect and classify the three most prominent types of brain tumors, i.e., glioma, meningioma and pituitary. For this purpose, we employ state-of-the-art pre-trained TL techniques to identify and detect glioma, meningioma and pituitary brain tumors. The aim is to identify the performance of nine pre-trained TL classifiers, i.e., Inceptionresnetv2, Inceptionv3, Xception, Resnet18, Resnet50, Resnet101, Shufflenet, Densenet201 and Mobilenetv2, by automatically identifying and detecting brain tumors using a fine-grained classification approach. For this, the TL algorithms are evaluated on a baseline brain tumor classification (MRI) dataset, which is freely available on Kaggle. Additionally, all deep learning (DL) models are fine-tuned with their default values. The fine-grained classification experiment demonstrates that the inceptionresnetv2 TL algorithm performs better and achieves the highest accuracy in detecting and classifying glioma, meningioma and pituitary brain tumors, and hence it can be classified as the best classification algorithm. We achieve 98.91% accuracy, 98.28% precision, 99.75% recall and 99% F-measure values with the inceptionresnetv2 TL algorithm, which out-performs the other DL algorithms. Additionally, to ensure and validate the performance of TL classifiers, we compare the efficacy of the inceptionresnetv2 TL algorithm with hybrid approaches, in which we use convolutional neural networks (CNN) for deep feature extraction and a Support Vector Machine (SVM) for classification. Similarly, the experiment’s results show that TL algorithms, and inceptionresnetv2 in particular, out-perform the state-of-the-art DL algorithms in classifying brain MRI images into glioma, meningioma, and pituitary. The hybrid DL approaches used in the experiments are Mobilnetv2, Densenet201, Squeeznet, Alexnet, Googlenet, Inceptionv3, Resnet50, Resnet18, Resnet101, Xception, Inceptionresnetv3, VGG19 and Shufflenet.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Brain Tumor Detection and Classification · Advanced Neural Network Applications · Digital Imaging for Blood Diseases

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan

Department of Software Engineering, University of Science and Technology Bannu, Bannu 28100, Pakistan

Department of Computer Software Engineering, University of Engineering and Technology Mardan, Mardan 23200, Pakistan

Department of Electrical Engineering, University of Science and Technology Bannu, Bannu 28100, Pakistan

Department of Biomedical Engineering, College of Engineering, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia

Department of Computer Science, College of Science & Art at Mahayil, King Khalid University, Abha 62529, Saudi Arabia

Department of Electrical Engineering, Faculty of Engineering & Technology, Future University in Egypt, New Cairo 11845, Egypt

Funding

Deanship of Scientific Research at King Khalid University · Princess Nourah bint Abdulrahman University Researchers

References (45)

Show source-provided references
1. Brain tumor segmentation using genetic algorithm with SVM classifier
2. An Improved Implementation of Brain Tumor Detection Using Segmentation Based on Hierarchical Self Organizing Map10.7763/IJCTE.2010.V2.207 ↗
3. Badran, E.F., Mahmoud, E.G., and Hamdy, N. (2010, January 30). An algorithm for detecting brain tumors in MRI images. Proceedings of the 2010 International Conference on Computer Engineering & Systems, Cairo, Egypt.10.1109/ICCES.2010.5674887 ↗
4. Cheng, J., Huang, W., Cao, S., Yang, R., Yang, W., Yun, Z., and Feng, Q. (2015). Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS ONE, 10.10.1371/journal.pone.0140381 ↗
5. Content-Based Brain Tumor Retrieval for MR Images Using Transfer Learning10.1109/ACCESS.2019.2892455 ↗
6. Multiclass classification of brain tumor in MR images
7. Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme10.1002/mrm.22147 ↗
8. A survey on deep learning in medical image analysis10.1016/j.media.2017.07.005 ↗
9. Singh, L., Chetty, G., and Sharma, D. (2012). A Novel Machine Learning Approach for Detecting the Brain Abnormalities from MRI Structural Images. IAPR International Conference on Pattern Recognition in Bioinformatics, Springer.10.1007/978-3-642-34123-6_9 ↗
10. Pan, Y., Huang, W., Lin, Z., Zhu, W., Zhou, J., Wong, J., and Ding, Z. (2015, January 25–29). Brain tumor grading based on Neural Networks and Convolutional Neural Networks. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.10.1109/EMBC.2015.7318458 ↗
11. Abiwinanda, N., Hanif, M., Hesaputra, S.T., Handayani, A., and Mengko, T.R. (2018, January 3–8). Brain tumor classification using convolutional neural network. Proceedings of the World Congress on Medical Physics and Biomedical Engineering 2018, Prague, Czech Republic.10.1007/978-981-10-9035-6_33 ↗
12. Classification using convolutional neural network for heart and diabetics datasets10.17148/IJARCCE.2016.51296 ↗
13. Deep Learning for Health Informatics10.1109/JBHI.2016.2636665 ↗
14. Le, Q.V.A. (2021, March 10). Tutorial on Deep Learning—Part 1: Nonlinear Classi-Fiers and the Backpropagation Algorithm. Available online: http://robotics.stanford.edu/∼quocle/tutorial1.pdf.
15. A novel training algorithm for convolutional neural network10.1007/s40747-016-0024-6 ↗
16. Pashaei, A., Sajedi, H., and Jazayeri, N. (2018, January 25–26). Brain Tumor Classification via Convolutional Neural Network and Extreme Learning Machines. Proceedings of the 2018 8th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran.10.1109/ICCKE.2018.8566571 ↗
17. A deep learning-based framework for automatic brain tumors classification using transfer learning10.1007/s00034-019-01246-3 ↗
18. Comparison of contrast-enhanced modified T1-weighted 3D TSE black-blood and 3D MP-RAGE sequences for the detection of cerebral metastases and brain tumours10.1007/s00330-015-3975-x ↗
19. Refining Parkinson’s neurological disorder identification through deep transfer learning10.1007/s00521-019-04069-0 ↗
20. Urdu Nastaliq recognition using convolutional–recursive deep learning10.1016/j.neucom.2017.02.081 ↗
21. Efficient brain tumor segmentation with multiscaleancer statistics twopathway-group conventional neural networks10.1109/JBHI.2018.2874033 ↗
22. Malarial parasite classification using recurrent neural network
23. Automatic Visual Features for Writer Identification: A Deep Learning Approach10.1109/ACCESS.2018.2890810 ↗
24. Ismael, M.R., and Abdel-Qader, I. (2018, January 3–5). Brain Tumor Classification via Statistical Features and Back-Propagation Neural Network. Proceedings of the 2018 IEEE International Conference on Electro/Information Technology (EIT), Rochester, MI, USA.10.1109/EIT.2018.8500308 ↗
25. Classification using deep learning neural networks for brain tumors10.1016/j.fcij.2017.12.001 ↗
26. Automated Categorization of Brain Tumor from MRI Using CNN features and SVM10.1007/s12652-020-02568-w ↗
27. Multi-level attention network: Application to brain tumor classification10.1007/s11760-021-02022-0 ↗
28. Afshar, P., Mohammadi, A., and Plataniotis, K.N. (2018, January 7–10). Brain tumor type classification via capsule networks. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.10.1109/ICIP.2018.8451379 ↗
29. Brain Tumor Classification Using Convolutional Neural Networks10.13005/bpj/1511 ↗
30. 2D MRI image analysis and brain tumor detection using deep learning CNN model LeU-Net10.1007/s11042-021-11504-9 ↗
31. Brain tumor detection and classification by hybrid CNN-DWA model using MR images10.2174/1573405617666210224113315 ↗
32. Efficient and low complex architecture for detection and classification of Brain Tumor using RCNN with Two Channel CNN
33. Transfer learning for visual categorization: A survey10.1109/TNNLS.2014.2330900 ↗
34. Agarwal, N., Sondhi, A., Chopra, K., and Singh, G. (2021). Transfer learning: Survey and classification. Smart Innovations in Communication and Computational Sciences, Springer.10.1007/978-981-15-5345-5_13 ↗
35. Sartaj, B., Ankita, K., Prajakta, B., Sameer, D., and Swati, K. Brain Tumor Classification (MRI). Kaggle, 2020.
36. A survey on transfer learning10.1109/TKDE.2009.191 ↗
37. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
38. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 19–24). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.10.1109/CVPR.2016.308 ↗
39. Chollet, F. (2016, January 19–24). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.10.1109/CVPR.2017.195 ↗
40. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 19–24). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.10.1109/CVPR.2016.90 ↗
41. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2016, January 19–24). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.
42. Huang, G., Zhuang, L., Laurens, V., Der, M., and Kilian, Q.W. (2016, January 19–24). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.10.1109/CVPR.2017.243 ↗
43. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
44. Sokolova, M., Japkowicz, N., and Szpakowicz, S. (2022, January 2–4). Beyond accuracy, F-score and ROC: A family of discriminant measures for performance evaluation. Proceedings of the Australasian Joint Conference on Artificial Intelligence, Sydney, NSW, Australia.
45. Brain tumor classification for MR images using transfer learning and fine-tuning10.1016/j.compmedimag.2019.05.001 ↗