journal article·2022Open access

Cartesian Product Based Transfer Learning Implementation for Brain Tumor Classification

Irfan Ahmed Usmani, Muhammad Tahir Qadri, Razia Zia, Asif Aziz, Farheen Saeed

Computers, Materials & Continua· Volume 73· Issue 2

Abstract

Knowledge-based transfer learning techniques have shown good performance for brain tumor classification, especially with small datasets. However, to obtain an optimized model for targeted brain tumor classification, it is challenging to select a pre-trained deep learning (DL) model, optimal values of hyperparameters, and optimization algorithm (solver). This paper first presents a brief review of recent literature related to brain tumor classification. Secondly, a robust framework for implementing the transfer learning technique is proposed. In the proposed framework, a Cartesian product matrix is generated to determine the optimal values of the two important hyperparameters: batch size and learning rate. An extensive exercise consisting of 435 simulations for 11 state-of-the-art pre-trained DL models was performed using 16 paired hyperparameters from the Cartesian product matrix to input the model with the three most popular solvers (stochastic gradient descent with momentum (SGDM), adaptive moment estimation (ADAM), and root mean squared propagation (RMSProp)). The 16 pairs were formed using individual hyperparameter values taken from literature, which generally addressed only one hyperparameter for optimization, rather than making a grid for a particular range. The proposed framework was assessed using a multi-class publicly available dataset consisting of glioma, meningioma, and pituitary tumors. Performance assessment shows that ResNet18 outperforms all other models in terms of accuracy, precision, specificity, and recall (sensitivity). The results are also compared with existing state-of-the-art research work that used the same dataset. The comparison was mainly based on performance metric “accuracy” with support of three other parameters “precision,” “recall,” and “specificity.” The comparison shows that the transfer learning technique, implemented through our proposed framework for brain tumor classification, outperformed all existing approaches. To the best of our knowledge, the proposed framework is an efficient framework that helped reduce the computational complexity and the time to attain optimal values of two important hyperparameters and consequently the optimized model with an accuracy of 99.56%.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Brain Tumor Detection and Classification · Machine Learning and ELM · Digital Imaging for Blood Diseases

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (74)

Show source-provided references
1. CAD system for automatic detection of brain tumor through magnetic resonance image—A review
2. Brain tumor imaging10.1200/JCO.2017.72.7636 ↗
3. Updated response assessment criteria for high-grade gliomas: Response assessment in neuro-oncology working group10.1200/JCO.2009.26.3541 ↗
4. Drevelegas · Imaging of Brain Tumors with Histological Correlations · 2011 · 1310.1007/978-3-540-87650-2_2 ↗
5. Enhanced performance of brain tumor classification via tumor region augmentation and partition10.1371/journal.pone.0144479 ↗
6. Retrieval of brain tumors by adaptive spatial pooling and fisher vector representation10.1371/journal.pone.0157112 ↗
7. Classification of brain MRI tumor images: A hybrid approach10.1016/j.procs.2017.11.400 ↗
8. MRI based medical image analysis: Survey on brain tumor grade classification10.1016/j.bspc.2017.07.007 ↗
9. Generating text with recurrent neural networks
10. A unified architecture for natural language processing: Deep neural networks with multitask learning
11. Jaitly · Proc. ICML Workshop on Deep Learning for Audio, Speech and Language · 2013 · 117 · 21
12. Deepface: Closing the gap to human-level performance in face verification
13. Szegedy · Advances in Neural Information Processing Systems · 2013 · 26 · 2553
14. Deep visual-semantic alignments for generating image descriptions
15. Deep neural networks in machine translation: An overview10.1109/MIS.2015.69 ↗
16. Mastering the game of Go with deep neural networks and tree search10.1038/nature16961 ↗
17. Deep MRI brain extraction: A 3D convolutional neural network for skull stripping10.1016/j.neuroimage.2016.01.024 ↗
18. Convolutional neural networks for medical image analysis: Full training or fine tuning?10.1109/TMI.2016.2535302 ↗
19. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
20. ImageNet large scale visual recognition challenge10.1007/s11263-015-0816-y ↗
21. Very deep convolutional networks for large-scale image recognition
22. The pascal visual object classes challenge 2012 (voc2012) development kit
23. L. Roux, “Mitosis Atypia 14 Grand Challenge,” 2014 [Online]. Available: https://mitos-atypia-14.grandcha.
24. A fast learning algorithm for deep belief nets10.1162/neco.2006.18.7.1527 ↗
25. Reducing the dimensionality of data with neural networks10.1126/science.1127647 ↗
26. Batch normalization: Accelerating deep network training by reducing internal covariate shift
27. Rectified linear units improve restricted Boltzmann machines
28. Dropout: A simple way to prevent neural networks from overfitting
29. Ensemble-classifiers-assisted detection of cerebral microbleeds in brain MRI10.1016/j.compeleceng.2018.02.021 ↗
30. Brain tumor segmentation with deep neural networks10.1016/j.media.2016.05.004 ↗
31. The multimodal brain tumor image segmentation benchmark (BraTS)10.1109/TMI.2014.2377694 ↗
32. Automatic brain tumor segmentation by subject specific modification of atlas priors110.1016/S1076-6332(03)00506-3 ↗
33. Neural networks analysis of astrocytic gliomas from MRI appearances10.1016/S0304-3835(97)00233-4 ↗
34. A hybrid approach for automatic classification of brain MRI using genetic algorithm and support vector machine
35. Brain tumor characterization using the soft computing technique of fuzzy cognitive maps10.1016/j.asoc.2007.06.006 ↗
36. Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme10.1002/mrm.22147 ↗
37. Computer-aided grading of gliomas based on local and global MRI features10.1016/j.cmpb.2016.10.021 ↗
38. A package-SFERCB-Segmentation, feature extraction, reduction and classification analysis by both SVM and ANN for brain tumors10.1016/j.asoc.2016.05.020 ↗
39. Cheng · Figshare MRI Dataset Version 5,
40. Brain tumor classification via statistical features and back-propagation neural network
41. A survey of feature selection and feature extraction techniques in machine learning
42. Deep learning10.1038/nature14539 ↗
43. Deep residual learning for image recognition
44. Brain tumor type classification via capsule networks
45. A new rectangular window based image cropping method for generalization of brain neoplasm classification systems10.1002/ima.22266 ↗
46. Multi-classification of brain tumor images using deep neural network10.1109/ACCESS.2019.2919122 ↗
47. Brain tumor identification and classification of MRI images using deep learning techniques10.1109/ACCESS.2020.3016319 ↗
48. Brain tumor detection and classification from multi-sequence MRI: Study using convnets
49. Inception-V4, inception-ResNet and the impact of residual connections on learning
50. Application of deep transfer learning for automated brain abnormality classification using MR images10.1016/j.cogsys.2018.12.007 ↗
51. Johnson · Harvard Medical School Data
52. Multi-grade brain tumor classification using deep CNN with extensive data augmentation10.1016/j.jocs.2018.12.003 ↗
53. Brain tumor classification for MR images using transfer learning and fine-tuning10.1016/j.compmedimag.2019.05.001 ↗
54. Content-based brain tumor retrieval for MR images using transfer learning10.1109/ACCESS.2019.2892455 ↗
55. Brain tumor classification using deep CNN features via transfer learning10.1016/j.compbiomed.2019.103345 ↗
56. Going deeper with convolutions
57. Transfer learning for domain adaptation in MRI: Application in brain lesion segmentation
58. Haarburger · Bildverarbeitung für die Medizin 2018 · 2018 · 21610.1007/978-3-662-56537-7_61 ↗
59. Multiclass magnetic resonance imaging brain tumor classification using artificial intelligence paradigm10.1016/j.compbiomed.2020.103804 ↗
60. Deep learning for multigrade brain tumor classification in smart healthcare systems: A prospective survey10.1109/TNNLS.2020.2995800 ↗
61. A transfer-learning approach for accelerated MRI using deep neural networks10.1002/mrm.28148 ↗
62. A deep learning model based on concatenation approach for the diagnosis of brain tumor10.1109/ACCESS.2020.2978629 ↗
63. Brain tumor classification based on fine-tuned models and the ensemble method10.32604/cmc.2021.014158 ↗
64. Brain tumor classification using fine-tuned GoogLeNet features and machine learning algorithms: IoMT enabled CAD system10.1109/JBHI.2021.3100758 ↗
65. Deep learning and improved particle swarm optimization based multimodal brain tumor classification10.32604/cmc.2021.015154 ↗
66. MRI-based brain tumor classification using ensemble of deep features and machine learning classifiers10.3390/s21062222 ↗
67. Multi-level attention network: Application to brain tumor classification10.1007/s11760-021-02022-0 ↗
68. State-of-the-art CNN optimizer for brain tumor segmentation in magnetic resonance images10.3390/brainsci10070427 ↗
69. A deep learning-based framework for automatic brain tumors classification using transfer learning10.1007/s00034-019-01246-3 ↗
70. Brain tumor classification via convolutional neural network and extreme learning machines
71. Places: An image database for deep scene understanding10.1167/17.10.296 ↗
72. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size
73. MobilenetV2: Inverted residuals and linear bottlenecks
74. Rethinking the inception architecture for computer vision