Deep Learning-Based Methods for Prostate Segmentation in Magnetic Resonance Imaging
Source abstract
Abstract
Magnetic Resonance Imaging-based prostate segmentation is an essential task for adaptive radiotherapy and for radiomics studies whose purpose is to identify associations between imaging features and patient outcomes. Because manual delineation is a time-consuming task, we present three deep-learning (DL) approaches, namely UNet, efficient neural network (ENet), and efficient residual factorized convNet (ERFNet), whose aim is to tackle the fully-automated, real-time, and 3D delineation process of the prostate gland on T2-weighted MRI. While UNet is used in many biomedical image delineation applications, ENet and ERFNet are mainly applied in self-driving cars to compensate for limited hardware availability while still achieving accurate segmentation. We apply these models to a limited set of 85 manual prostate segmentations using the k-fold validation strategy and the Tversky loss function and we compare their results. We find that ENet and UNet are more accurate than ERFNet, with ENet much faster than UNet. Specifically, ENet obtains a dice similarity coefficient of 90.89% and a segmentation time of about 6 s using central processing unit (CPU) hardware to simulate real clinical conditions where graphics processing unit (GPU) is not always available. In conclusion, ENet could be efficiently applied for prostate delineation even in small image training datasets with potential benefit for patient management personalization.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Prostate Cancer Diagnosis and Treatment · Advanced Neural Network Applications · Medical Image Segmentation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Ri.MED Foundation, Via Bandiera, 11, 90133 Palermo, Italy
Institute of Molecular Bioimaging and Physiology, National Research Council (IBFM-CNR), 90015 Cefalù, Italy
Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
Dipartimento di Biomedicina, Neuroscienze e Diagnostica avanzata (BIND), University of Palermo, 90127 Palermo, Italy
References (53)
Show source-provided references
1. Stefano, A., Comelli, A., Bravata, V., Barone, S., Daskalovski, I., Savoca, G., Sabini, M.G., Ipplito, M., and Russo, G. (2020). A preliminary PET radiomics study of brain metastases using a fully automatic segmentation method. BMC Bioinform., 21.10.1186/s12859-020-03647-7 ↗
2. Clinically significant prostate cancer detection on MRI: A radiomic shape features study10.1016/j.ejrad.2019.05.006 ↗
3. Dos Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study10.1097/RLI.0000000000000530 ↗
4. Parameters influencing PET imaging features: A phantom study with irregular and heterogeneous synthetic lesions10.1155/2018/5324517 ↗
5. Comelli, A., Stefano, A., Coronnello, C., Russo, G., Vernuccio, F., Cannella, R., Salvaggio, G., Lagalla, R., and Barone, S. (2020). Radiomics: A New Biomedical Workflow to Create a Predictive Model, Springer.10.1007/978-3-030-52791-4_22 ↗
6. A smart and operator independent system to delineate tumours in Positron Emission Tomography scans10.1016/j.compbiomed.2018.09.002 ↗
7. Integrated 3D anatomical model for automatic myocardial segmentation in cardiac CT imagery10.1080/21681163.2019.1583607 ↗
8. Comelli, A. (2020). Fully 3D Active Surface with Machine Learning for PET Image Segmentation. J. Imaging, 6.10.3390/jimaging6110113 ↗
9. A review on segmentation of positron emission tomography images10.1016/j.compbiomed.2014.04.014 ↗
10. Bi, L., Kim, J., Wen, L., Feng, D., and Fulham, M. (2015, January 16–19). Automated thresholded region classification using a robust feature selection method for PET-CT. Proceedings of the International Symposium on Biomedical Imaging, Brooklyn, NY, USA.10.1109/ISBI.2015.7164146 ↗
11. Dhanachandra, N., Manglem, K., and Chanu, Y.J. (2015, January 18–19). Image Segmentation Using K-means Clustering Algorithm and Subtractive Clustering Algorithm. Proceedings of the Procedia Computer Science, Algiers, Algeria.10.1016/j.procs.2015.06.090 ↗
12. Chevrefils, C., Chériet, F., Grimard, G., and Aubin, C.E. (2007, January 8–11). Watershed segmentation of intervertebral disk and spinal canal from MRI images. Proceedings of the Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Redondo Beach, CA, USA.
13. Development of a new fully three-dimensional methodology for tumours delineation in functional images10.1016/j.compbiomed.2020.103701 ↗
14. Fast approximate energy minimization via graph cuts10.1109/34.969114 ↗
15. A fully automatic method for biological target volume segmentation of brain metastases10.1002/ima.22154 ↗
16. Plath, N., Toussaint, M., and Nakajima, S. (2009, January 14–18). Multi-class image segmentation using conditional random fields and global classification. Proceedings of the 26th International Conference on Machine Learning, ICML 2009, Montreal, QC, Canada.10.1145/1553374.1553479 ↗
17. Artificial Intelligence in Cardiovascular Imaging: JACC State-of-the-Art Review10.1016/j.jacc.2018.12.054 ↗
18. Zhou, T., Fu, H., Zhang, Y., Zhang, C., Lu, X., Shen, J., and Shao, L. (2020). M2Net: Multi-modal Multi-channel Network for overall survival time prediction of brain tumor patients. arXiv.10.1007/978-3-030-59713-9_22 ↗
19. Machine learning applications in prostate cancer magnetic resonance imaging10.1186/s41747-019-0109-2 ↗
20. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
21. Stacked denoising autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion
22. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
23. Ghiasi, G., and Fowlkes, C.C. (2016, January 8–16). Laplacian pyramid reconstruction and refinement for semantic segmentation. Proceedings of the Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Amsterdam, The Netherlands.10.1007/978-3-319-46487-9_32 ↗
24. He, J., Deng, Z., and Qiao, Y. (November, January 27). Dynamic multi-scale filters for semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea.
25. Chen, L.C., Yang, Y., Wang, J., Xu, W., and Yuille, A.L. (July, January 26). Attention to Scale: Scale-Aware Semantic Image Segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
26. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
27. Radford, A., Metz, L., and Chintala, S. (2016, January 2–4). Unsupervised representation learning with deep convolutional generative adversarial networks. Proceedings of the 4th International Conference on Learning Representations, ICLR 2016—Conference Track Proceedings, San Juan, Puerto Rico.
28. Mirza, M., and Osindero, S. (2018). Conditional Generative Adversarial Nets Mehdi. arXiv.
29. Chena, X., Yao, L., Zhou, T., Dong, J., and Zhang, Y. (2020). Momentum Contrastive Learning for Few-Shot COVID-19 Diagnosis from Chest CT Images. arXiv.10.1016/j.patcog.2021.107826 ↗
30. Chen, X., Yao, L., and Zhang, Y. (2020). Residual attention U-net for automated multi-class segmentation of COVID-19 chest CT images. arXiv.
31. A survey on deep learning techniques for image and video semantic segmentation10.1016/j.asoc.2018.05.018 ↗
32. A survey on deep learning in medical image analysis10.1016/j.media.2017.07.005 ↗
33. High-intensity focused ultrasound plus concomitant radiotherapy: A new weapon in oncology?10.1186/2050-5736-1-6 ↗
34. Benign Prostatic Hyperplasia
35. Correlation between prostatitis, benign prostatic hyperplasia and prostate cancer: A systematic review and meta-analysis10.7150/jca.37235 ↗
36. Giambelluca, D., Cannella, R., Vernuccio, F., Comelli, A., Pavone, A., Salvaggio, L., Galia, M., Midiri, M., Lagalla, R., and Salvaggio, G. (2019). PI-RADS 3 Lesions: Role of Prostate MRI Texture Analysis in the Identification of Prostate Cancer. Curr. Probl. Diagn. Radiol., In press.
37. Prostate MRI technical parameters standardization: A systematic review on adherence to PI-RADSv2 acquisition protocol10.1016/j.ejrad.2019.108662 ↗
38. Fully automated prostate segmentation on MRI: Comparison with manual segmentation methods and specimen volumes10.2214/AJR.12.9712 ↗
39. Computational imaging reveals shape differences between normal and malignant prostates on MRI10.1038/srep41261 ↗
40. A kernel support vector machine based technique for Crohn’s disease classification in human patients10.1007/978-3-319-61566-0_25 ↗
41. A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images10.1016/j.cmpb.2012.04.006 ↗
42. Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge10.1016/j.media.2013.12.002 ↗
43. Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation. arXiv.
44. ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation10.1109/TITS.2017.2750080 ↗
45. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 13–15). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Fuzhou, China.10.1007/978-3-319-24574-4_28 ↗
46. (2019, February 17). Prostate Imaging Reporting & Data System (PI-RADS). Available online: https://www.acr.org/Clinical-Resources/Reporting-and-Data-Systems/PI-RADS.
47. Simultaneous truth and performance level estimation (STAPLE): An algorithm for the validation of image segmentation10.1109/TMI.2004.828354 ↗
48. Comelli, A., Dahiya, N., Stefano, A., Benfante, V., Gentile, G., Agnese, V., Raffa, G.M., Pilato, M., Yezzi, A., and Petrucci, G. (2020). Deep learning approach for the segmentation of aneurysmal ascending aorta. Biomed. Eng. Lett., 1–10.10.1007/s13534-020-00179-0 ↗
49. Comelli, A., Coronnello, C., Dahiya, N., Benfante, V., Palmucci, S., Basile, A., Vancheri, C., Russo, G., Yezzi, A., and Stefano, A. (2020). Lung Segmentation on High-Resolution Computerized Tomography Images Using Deep Learning: A Preliminary Step for Radiomics Studies. J. Imaging, 6.10.3390/jimaging6110125 ↗
50. Salehi, S.S.M., Erdogmus, D., and Gholipour, A. (2017, January 10). Tversky loss function for image segmentation using 3D fully convolutional deep networks. Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Quebec City, QC, Canada.10.1007/978-3-319-67389-9_44 ↗
51. Features of similarity10.1037/0033-295X.84.4.327 ↗
52. Kingma, D.P., and Ba, J.L. (2015, January 7–9). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015—Conference Track Proceedings, San Diego, CA, USA.
53. Zheng, H., Yang, L., Chen, J., Han, J., Zhang, Y., Liang, P., Zhao, Z., Wang, C., and Chen, D.Z. (February, January 27). Biomedical image segmentation via representative annotation. Proceedings of the 33rd AAAI Conference on Artificial Intelligence, AAAI 2019, Honolulu, HI, USA.10.1609/aaai.v33i01.33015901 ↗