journal article·2026-01-14Open access

Deep Learning Approaches for Brain Tumor Classification in MRI Scans: An Analysis of Model Interpretability

Emanuela F. Gomes, Ramiro S. Barbosa

Applied Sciences· Volume 16· Issue 2

Abstract

This work presents the development and evaluation of Artificial Intelligence (AI) models for the automatic classification of brain tumors in Magnetic Resonance Imaging (MRI) scans. Several deep learning architectures were implemented and compared, including VGG-19, ResNet50, EfficientNetB3, Xception, MobileNetV2, DenseNet201, InceptionV3, Vision Transformer (ViT), and an Ensemble model. The models were developed in Python (version 3.12.4) using the Keras and TensorFlow frameworks and trained on a public Brain Tumor MRI dataset containing 7023 images. Data augmentation and hyperparameter optimization techniques were applied to improve model generalization. The results showed high classification performance, with accuracies ranging from 89.47% to 98.17%. The Vision Transformer achieved the best performance, reaching 98.17% accuracy, outperforming traditional Convolutional Neural Network (CNN) architectures. Explainable AI (XAI) methods Grad-CAM, LIME, and Occlusion Sensitivity were employed to assess model interpretability, showing that the models predominantly focused on tumor regions. The proposed approach demonstrated the effectiveness of AI-based systems in supporting early diagnosis of brain tumors, reducing analysis time and assisting healthcare professionals.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Brain Tumor Detection and Classification · Radiomics and Machine Learning in Medical Imaging · Glioma Diagnosis and Treatment

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical Engineering, Institute of Engineering—Polytechnic of Porto (ISEP/IPP), 4249-015 Porto, Portugal

GECAD-Research Group on Intelligent Engineering and Computing for Advanced Innovation and Development, ISEP/IPP, 4249-015 Porto, Portugal

References (47)

Show source-provided references
1. Missaoui, R., Hechkel, W., Saadaoui, W., Helali, A., and Leo, M. (2025). Advanced Deep Learning and Machine Learning Techniques for MRI Brain Tumor Analysis: A Review. Sensors, 25.10.3390/s25092746 ↗
2. Automatic brain MRI tumors segmentation based on deep fusion of weak edge and context features10.1007/s10462-025-11151-8 ↗
3. Brain tumor detection, classification and segmentation by deep learning models from MRI images: Recent approaches, challenges and future directions10.1016/j.array.2025.100571 ↗
4. Brain tumor segmentation in MRI with multi-modality spatial information enhancement and boundary shape correction10.1016/j.patcog.2024.110553 ↗
5. A survey on brain tumor image analysis10.1007/s11517-023-02873-4 ↗
6. A survey of methods for brain tumor segmentation-based MRI images
7. Rios Piedra, E.A., Taira, R.K., El-Saden, S., Ellingson, B.M., Bui, A.A.T., and Hsu, W. (2016, January 24–27). Assessing variability in brain tumor segmentation to improve volumetric accuracy and characterization of change. Proceedings of the 2016 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Las Vegas, NV, USA.10.1109/BHI.2016.7455914 ↗
8. Rajeyyagari, S., Hung, B.T., and Chakrabarti, P. (2022, January 23–25). Applications of Artificial Intelligence in Biomedical Image Processing. Proceedings of the Proceedings of the Second International Conference on Artificial Intelligence and Smart Energy (ICAIS-2022), Coimbatore, India.10.1109/ICAIS53314.2022.9742773 ↗
9. Medical Image Segmentation Using Deep Semantic-based Methods: A Review of Techniques, Applications and Emerging Trends10.1016/j.inffus.2022.09.031 ↗
10. An Explainable AI System for Medical Image Segmentation With Preserved Local Resolution: Mammogram Tumor Segmentation10.1109/ACCESS.2023.3330465 ↗
11. Unveiling the black box: A systematic review of Explainable Artificial Intelligence in medical image analysis10.1016/j.csbj.2024.08.005 ↗
12. Explainable AI and vision transformers for detection and classification of brain tumor: A comprehensive survey10.1007/s10462-025-11221-x ↗
13. Deep Learning in Medical Image Analysis: A Survey
14. Optimized Deep Learning Model for Medical Image Diagnosis10.1016/j.jer.2024.11.003 ↗
15. Optimized Deep Learning Model for Comprehensive Medical Image Analysis Across Multiple Modalities10.1016/j.neucom.2024.129182 ↗
16. Evaluating Pre-processing and Deep Learning Methods in Medical Imaging: Combined Effectiveness Across Multiple Modalities10.1016/j.aej.2025.01.090 ↗
17. Rashed, B.M., and Popescu, N. (2021, January 18–19). Machine Learning Techniques for Medical Image Processing. Proceedings of the 9th IEEE International Conference on e-Health and Bioengineering (EHB), Iasi, Romania.
18. The Role of Advanced Machine Learning in COVID-19 Medical Imaging: A Technical Review10.1016/j.rineng.2025.105154 ↗
19. Machine Learning Methods for Histopathological Image Analysis: Updates in 202410.1016/j.csbj.2024.12.033 ↗
20. Comparison of Vision Transformers and Convolutional Neural Networks in Medical Image Analysis: A Systematic Review10.1007/s10916-024-02105-8 ↗
21. Comparative evaluation of lightweight convolutional neural network and vision transformer models for multi-class brain tumor classification using merged large MRI datasets10.1016/j.chemolab.2025.105609 ↗
22. (2025, April 21). AI Solutions for Radiology. Available online: https://www.aidoc.com.
23. Health, G. (2025, April 21). Health Solutions. Available online: https://health.google.
24. (2025, April 21). AI-Powered Pathology Solutions. Available online: https://www.pathai.com.
25. Viz.ai (2025, April 21). Viz 3D CTATM. Available online: https://www.viz.ai/large-vessel-occlusion.
26. (2025, April 21). Tempus Pixel Lung. Available online: https://www.tempus.com/radiology/tempus-pixel-lung/.
27. Qure.ai (2025, April 21). Qure.ai. Available online: https://www.qure.ai.
28. (2025, April 21). AI-powered Cancer Screening and Treatment Solutions. Available online: https://www.lunit.io/en.
29. (2025, May 08). Annotated Ultrasound Liver Images Dataset. Available online: https://www.kaggle.com/datasets/orvile/annotated-ultrasound-liver-images-dataset.
30. (2025, May 08). Human Bone Fractures Image Dataset (HBFMID). Available online: https://www.kaggle.com/datasets/orvile/human-bone-fractures-image-dataset-hbfmid.
31. Oza, P., Oza, U., Oza, R., Sharma, P., Patel, S., Kumar, P., and Gohel, B. (2025, May 08). Digital Mammography Dataset for Breast Cancer Diagnosis Research (DMID)—Breast Cancer Mammography Dataset. Available online: https://www.kaggle.com/datasets/orvile/dmid-breast-cancer-mammography-dataset?select=ROI+Masks.
32. González, J.L. (2025, May 10). Tumores Cerebrales—MRI Dataset. Available online: https://www.kaggle.com/datasets/gonzajl/tumores-cerebrales-mri-dataset.
33. Mooney, P. (2025, May 10). Chest X-Ray Images (Pneumonia) Dataset. Available online: https://www.kaggle.com/datasets/paultimothymooney/chest-xray-pneumonia.
34. Heller, N., Sathianathen, N., Kalapara, A., Walczak, E., Moore, K., Kaluzniak, H., Rosenberg, J., Blake, P., Rengel, Z., and Oestreich, M. (2025, May 10). KiTS19-Kidney Tumor Segmentation Challenge Dataset. Available online: https://www.kaggle.com/datasets/orvile/kits19-png-zipped.
35. Tschandl, P., Rosendahl, C., and Kittler, H. (2025, May 12). HAM10000: Human Against Machine with 10,000 Training Images—A Large Collection of Multi-Source Dermatoscopic Images of Pigmented Skin Lesions. Available online: https://www.kaggle.com/datasets/kmader/skin-cancer-mnist-ham10000.
36. Soares, E., Angelov, P., Biaso, S., Fróes, M.H., and Abe, D.K. (2025, May 10). SARS-CoV-2 CT-Scan Dataset: A Large Dataset of Real Patients CT Scans for SARS-CoV-2 Identification. Available online: https://www.kaggle.com/datasets/plameneduardo/sarscov2-ctscan-dataset.
37. (2025, May 10). DRIVE—Digital Retinal Images for Vessel Extraction. Available online: https://www.kaggle.com/datasets/andrewmvd/drive-digital-retinal-images-for-vessel-extraction.
38. Daithal, N. (2025, May 10). ImageOASIS Dataset. Available online: https://www.kaggle.com/datasets/ninadaithal/imagesoasis.
39. Transformers in Vision: A Survey10.1145/3505244 ↗
40. Müller, D., Soto-Rey, I., and Kramer, F. (2022). Towards a guideline for evaluation metrics in medical image segmentation. BMC Res. Notes, 15.10.1186/s13104-022-06096-y ↗
41. Tiwari, R., and Agrawal, R. (2024, January 19–20). Unmasking VGG16: LIME Visualizations for Brain Tumor Diagnosis. Proceedings of the 2024 International Conference on Computer Vision and Machine Intelligence (CVMI), Prayagraj, India.10.1109/CVMI61877.2024.10781708 ↗
42. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization10.1007/s11263-019-01228-7 ↗
43. Transfer learning architectures with fine-tuning for brain tumor classification using magnetic resonance imaging10.1016/j.health.2023.100270 ↗
44. Nickparvar, M. (2025, July 19). Brain Tumor MRI Dataset. Available online: https://www.kaggle.com/datasets/masoudnickparvar/brain-tumor-mri-dataset?select=Training.
45. Chollet, F. (2018). Deep Learning with Python, Manning Publications.
47. Draelos, R.L., and Carin, L. (2020). Use HIRE-SCAM instead of Grad-CAM for faithful explanations of convolutional neural networks. arXiv.