Investigating the Behaviour of Machine Learning Techniques to Segment Brain Metastases in Radiation Therapy Planning
Source abstract
Abstract
This work aimed to investigate whether automated classifiers belonging to feature-based and deep learning may approach brain metastases segmentation successfully. Support Vector Machine and V-Net Convolutional Neural Network are selected as representatives of the two approaches. In the experiments, we consider several configurations of the two methods to segment brain metastases on contrast-enhanced T1-weighted magnetic resonance images. Performances were evaluated and compared under critical conditions imposed by the clinical radiotherapy domain, using in-house dataset and public dataset created for the Multimodal Brain Tumour Image Segmentation (BraTS) challenge. Our results showed that the feature-based and the deep network approaches are promising for the segmentation of Magnetic Resonance Imaging (MRI) brain metastases achieving both an acceptable level of performance. Experimental results also highlight different behaviour between the two methods. Support vector machine (SVM) improves performance with a smaller training set, but it is unable to manage a high level of heterogeneity in the data and requires post-processing refinement stages. The V-Net model shows good performances when trained on multiple heterogeneous cases but requires data augmentations and transfer learning procedures to optimise its behaviour. The paper illustrates a software package implementing an integrated set of procedures for active support in segmenting brain metastases within the radiotherapy workflow.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Brain Tumor Detection and Classification · Radiomics and Machine Learning in Medical Imaging · Advanced Radiotherapy Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Theoretical and Applied Science, University of Insubria, 21100 Varese, Italy
Department of Physics, University of Milan, 20122 Milan, Italy
C.S. Health Physics, ASST dei Sette Laghi, 21100 Varese, Italy
References (46)
Show source-provided references
1. Incidence and prognosis of patients with brain metastases at diagnosis of systemic malignancy: A population-based study10.1093/neuonc/nox077 ↗
2. Greenberg, H.S., Chandler, W.F., and Sandler, H.M. (1999). Brain Tumors, Oxford University Press.10.1093/oso/9780195129588.001.0001 ↗
3. State of the art survey on MRI brain tumor segmentation10.1016/j.mri.2013.05.002 ↗
4. Automatic metastatic brain tumor segmentation for stereotactic radiosurgery applications10.1088/0031-9155/61/24/8440 ↗
5. Intraoperative brain cancer detection with Raman spectroscopy in humans10.1126/scitranslmed.aaa2384 ↗
6. Detection of Human Brain Cancer Infiltration ex vivo and in vivo Using Quantitative Optical Coherence Tomography10.1126/scitranslmed.3010611 ↗
7. Watershed-Based Segmentation and Region Merging10.1006/cviu.1999.0822 ↗
8. Ilunga Mbuyamba, E., Cruz-Duarte, J., Avina-Cervantes, J., Rodrigo Correa-Cely, C., Lindner, D., and Chalopin, C. (2016). Active Contours Driven by Cuckoo Search Strategy for Brain Tumour Images Segmentation. Expert Syst. Appl., 56.10.1016/j.eswa.2016.02.048 ↗
9. Tumor or abnormality identification from magnetic resonance images using statistical region fusion based segmentation10.1016/j.mri.2016.07.002 ↗
10. A survey of MRI-based medical image analysis for brain tumor studies10.1088/0031-9155/58/13/R97 ↗
11. Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions10.1007/s10278-017-9983-4 ↗
12. Pedoia, V., Balbi, S., and Binaghi, E. (2015, January 7–11). Fully Automatic Brain Tumor Segmentation by Using Competitive EM and Graph Cut. Proceedings of the 18th International Conference on Image Analysis and Processing, Genoa, Italy.10.1007/978-3-319-23231-7_51 ↗
13. Meningioma and peritumoral edema segmentation of preoperative MRI brain scans10.1080/21681163.2016.1250108 ↗
14. Segmentation, feature extraction, and multiclass brain tumor classification10.1007/s10278-013-9600-0 ↗
15. Tumor margin identification and prediction of the primary tumor from brain metastases using FTIR imaging and support vector machines10.1039/c3an00326d ↗
16. Automated diagnosis of brain tumours astrocytomas using probabilistic neural network clustering and support vector machines10.1142/S0129065705000013 ↗
17. Vapnik, V. (2000). The Nature of Statistical Learning Theory, Springer. Available online: https://www.springer.com/gp/book/9780387987804.10.1007/978-1-4757-3264-1 ↗
18. Suykens, J.A.K. (2002). Least Squares Support Vector Machines, World Scientific.10.1142/5089 ↗
19. Ho, T.K. (1995, January 14–16). Random decision forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, Canada.
20. Early Cancer Detection from Multianalyte Blood Test Results10.1016/j.isci.2019.04.035 ↗
21. Cai, H., Verma, R., Ou, Y., Lee, S., Melhem, E.R., and Davatzikos, C. (2007, January 12–15). Probabilistic Segmentation of Brain Tumors Based on Multi-Modality Magnetic Resonance Images. Proceedings of the 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Arlington, VA, USA.10.1109/ISBI.2007.356923 ↗
22. Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of MR images10.1016/j.acra.2008.01.029 ↗
23. Ruan, S., Lebonvallet, S., Merabet, A., and Constans, J. (2007, January 12–15). Tumor Segmentation from a Multispectral Mri Images by Using Support Vector Machine Classification. Proceedings of the 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Arlington, VA, USA.10.1109/ISBI.2007.357082 ↗
24. Bauer, S., Nolte, L.P., and Reyes, M. (2011, January 18–22). Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. Proceedings of the 14th International Conference on Medical Image Computing and Computer-Assisted Intervention, Toronto, ON, Canada.10.1007/978-3-642-23626-6_44 ↗
25. Zikic, D., Glocker, B., Konukoglu, E., Criminisi, A., Demiralp, C., Shotton, J., Thomas, O.M., Das, T., Jena, R., and Price, S.J. (2012, January 1–5). Decision forests for tissue-specific segmentation of high-grade gliomas in multi-channel MR. Proceedings of the 15th International Conference on Medical Image Computing and Computer-Assisted Intervention, Nice, France.10.1007/978-3-642-33454-2_46 ↗
26. Geremia, E., Menze, B., Prastawa, M., Weber, M.-A., Criminisi, A., and Ayache, N. (2012, January 5). Brain Tumor Cell Density Estimation from Multi-modal MR Images Based on a Synthetic Tumor Growth Model. Proceedings of the Second International Conference on Medical Computer Vision: Recognition Techniques and Applications in Medical Imaging, Nice, France.10.1007/978-3-642-36620-8_27 ↗
27. Automatic detection and segmentation of brain metastases on multimodal MR images with a deep convolutional neural network10.1016/j.compbiomed.2018.02.004 ↗
28. Brain Metastases Detection Algorithms in Magnetic Resonance Imaging10.1109/TLA.2016.7459586 ↗
29. Wachinger, C., and Golland, P. (2014, January 14–18). Atlas-Based Under-Segmentation. Proceedings of the 17th International Conference on Medical Image Computing and Computer-Assisted Intervention, Boston, MA, USA.10.1007/978-3-319-10404-1_40 ↗
30. Losch, M. (2015). Detection and Segmentation of Brain Metastases with Deep Convolutional Networks. [Master’s Thesis, KTH Royal Institute of Technology in Stockholm].
31. Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation10.1016/j.media.2016.10.004 ↗
32. Liu, Y., Stojadinovic, S., Hrycushko, B., Wardak, Z., Lau, S., Lu, W., Yan, Y., Jiang, S.B., Zhen, X., and Timmerman, R. (2017). A deep convolutional neural network-based automatic delineation strategy for multiple brain metastases stereotactic radiosurgery. PLoS ONE, 12.10.1371/journal.pone.0185844 ↗
33. Grøvik, E., Yi, D., Iv, M., Tong, E., Rubin, D., and Zaharchuk, G. (2019). Deep learning enables automatic detection and segmentation of brain metastases on multisequence MRI. J. Magn. Reson. Imaging.10.1002/jmri.26766 ↗
34. Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25–28). V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV 2016), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
35. Gonella, G., Binaghi, E., Nocera, P., and Mordacchini, C. (2019, January 17–19). Semi-Automatic Segmentation of MRI Brain Metastases combining Support Vector Machine and Morphological Operators. Proceedings of the 11th International Conference on Neural Computation Theory and Applications, Vienna, Austria.10.5220/0008019304570463 ↗
36. Statnikov, A., Wang, L., and Aliferis, C.F. (2008). A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification. BMC Bioinform., 9.10.1186/1471-2105-9-319 ↗
37. A Survey on Deep Learning in Medical Image Analysis10.1016/j.media.2017.07.005 ↗
38. Schölkopf, B., and Smola, A.J. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.10.7551/mitpress/4175.001.0001 ↗
39. Tuceryan, M., and Jain, A.K. (1994). Texture Analysis. Handbook of Pattern Recognition and Image Processing (Vol. 2), Academic Press, Inc.10.1142/9789814343138_0010 ↗
40. (2019, July 14). 3D Deep Learning: Lung Tumor Segmentation-File Exchange-MATLAB Central. Available online: https://www.mathworks.com/matlabcentral/fileexchange/71521-3-d-deep-learning-lung-tumor-segmentation.
41. Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
42. He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.10.1109/CVPR.2016.90 ↗
43. (2019, July 14). ImageNet Classification with Deep Convolutional Neural Networks BibSonomy. Available online: https://www.bibsonomy.org/bibtex/2886c491fe45049fee3c9660df30bb5c4/albinzehe.
44. (2019, July 14). The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)-IEEE Journals & Magazine. Available online: https://ieeexplore.ieee.org/document/6975210.
45. On Evaluating Brain Tissue Classifiers without a Ground Truth10.1016/j.neuroimage.2007.04.031 ↗
46. Measures of the Amount of Ecologic Association Between Species10.2307/1932409 ↗