journal article·2023-11-02Open access

BTDNet: A Multi-Modal Approach for Brain Tumor Radiogenomic Classification

Dimitrios Kollias, Karanjot Vendal, Priyankaben Gadhavi, Solomon Russom

Applied Sciences· Volume 13· Issue 21

Abstract

Brain tumors pose significant health challenges worldwide, with glioblastoma being one of the most aggressive forms. The accurate determination of the O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status is crucial for personalized treatment strategies. However, traditional methods are labor-intensive and time-consuming. This paper proposes a novel multi-modal approach, BTDNet, that leverages multi-parametric MRI scans, including FLAIR, T1w, T1wCE, and T2 3D volumes, to predict the MGMT promoter methylation status. BTDNet’s main contribution involves addressing two main challenges: the variable volume lengths (i.e., each volume consists of a different number of slices) and the volume-level annotations (i.e., the whole 3D volume is annotated and not the independent slices that it consists of). BTDNet consists of four components: (i) data augmentation (which performs geometric transformations, convex combinations of data pairs, and test-time data augmentation); (ii) 3D analysis (which performs global analysis through a CNN-RNN); (iii) routing (which contains a mask layer that handles variable input feature lengths); and (iv) modality fusion (which effectively enhances data representation, reduces ambiguities, and mitigates data scarcity). The proposed method outperformed state-of-the-art methods in the RSNA-ASNR-MICCAI BraTS 2021 Challenge by at least 3.3% in terms of the F1 score, offering a promising avenue for enhancing brain tumor diagnosis and treatment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Domain Adaptation and Few-Shot Learning · Glioma Diagnosis and Treatment

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electronic Engineering and Computer Science, Queen Mary University of London, London E1 4NS, UK

References (29)

Show source-provided references
1. Current challenges and opportunities in treating glioblastoma10.1124/pr.117.014944 ↗
2. Glioblastoma: Clinical presentation, diagnosis, and management10.1136/bmj.n1560 ↗
3. Radiomics and radiogenomics in lung cancer: A review for the clinician10.1016/j.lungcan.2017.10.015 ↗
4. Non-invasive tumor genotyping using radiogenomic biomarkers, a systematic review and oncology-wide pathway analysis10.18632/oncotarget.24893 ↗
5. Current clinical brain tumor imaging10.1093/neuros/nyx103 ↗
6. MGMT promoter methylation is predictive of response to radiotherapy and prognostic in the absence of adjuvant alkylating chemotherapy for glioblastoma10.1093/neuonc/nop020 ↗
7. The 2016 World Health Organization classification of tumors of the central nervous system: A summary10.1007/s00401-016-1545-1 ↗
8. Baba, F. (2023, October 29). RSNA-MICCAI Brain Tumor Radiogenomic Classification. Available online: https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/281347.
9. Roberts, D. (2023, October 29). RSNA-MICCAI Brain Tumor Radiogenomic Classification. Available online: https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/280033.
10. Phan, M. (2023, October 29). RSNA-MICCAI Brain Tumor Radiogenomic Classification. Available online: https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/280029.
11. Soares, C. (2023, October 29). RSNA-MICCAI Brain Tumor Radiogenomic Classification. Available online: https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/287713.
12. Tangirala, B. (2023, October 29). RSNA-MICCAI Brain Tumor Radiogenomic Classification. Available online: https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/281911.
13. Radosavovic, I., Dollár, P., Girshick, R., Gkioxari, G., and He, K. (2018, January 18–23). Data distillation: Towards omni-supervised learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00433 ↗
14. Santurkar, S., Tsipras, D., Ilyas, A., and Madry, A. (2018). How does batch normalization help optimization?. Adv. Neural Inf. Process. Syst., 31.
15. Hendrycks, D., and Gimpel, K. (2016). Gaussian error linear units (gelus). arXiv.
16. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
17. Baid, U., Ghodasara, S., Mohan, S., Bilello, M., Calabrese, E., Colak, E., Farahani, K., Kalpathy-Cramer, J., Kitamura, F.C., and Pati, S. (2021). The rsna-asnr-miccai brats 2021 benchmark on brain tumor segmentation and radiogenomic classification. arXiv.
18. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
19. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
20. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
21. Jocher, G. (2020). YOLOv5 by Ultralytics. Zenodo.
22. Psaroudakis, A., and Kollias, D. (2022, January 18–24). Mixaugment & mixup: Augmentation methods for facial expression recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00264 ↗
23. Convolutional networks for images, speech, and time series
24. Learning to forget: Continual prediction with LSTM10.1162/089976600300015015 ↗
25. Powers, D.M. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv.
26. Schütze, H., Manning, C.D., and Raghavan, P. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
27. Backpropagation and stochastic gradient descent method10.1016/0925-2312(93)90006-O ↗
28. Foret, P., Kleiner, A., Mobahi, H., and Neyshabur, B. (2020). Sharpness-aware minimization for efficiently improving generalization. arXiv.
29. Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 18–24). A convnet for the 2020s. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01167 ↗