journal article·2020-02-03Open access

A Deep-Learning Approach for Diagnosis of Metastatic Breast Cancer in Bones from Whole-Body Scans

Nikolaos Papandrianos, Elpiniki Papageorgiou, Athanasios Anagnostis, Anna Feleki

Applied Sciences· Volume 10· Issue 3

Abstract

(1) Background: Bone metastasis is one of the most frequent diseases in breast, lung and prostate cancer; bone scintigraphy is the primary imaging method of screening that offers the highest sensitivity (95%) regarding metastases. To address the considerable problem of bone metastasis diagnosis, focused on breast cancer patients, artificial intelligence methods devoted to deep-learning algorithms for medical image analysis are investigated in this research work; (2) Methods: Deep learning is a powerful algorithm for automatic classification and diagnosis of medical images whereas its implementation is achieved by the use of convolutional neural networks (CNNs). The purpose of this study is to build a robust CNN model that will be able to classify images of whole-body scans in patients suffering from breast cancer, depending on whether or not they are infected by metastasis of breast cancer; (3) Results: A robust CNN architecture is selected based on CNN exploration performance for bone metastasis diagnosis using whole-body scan images, achieving a high classification accuracy of 92.50%. The best-performing CNN method is compared with other popular and well-known CNN architectures for medical imaging like ResNet50, VGG16, MobileNet, and DenseNet, reported in the literature, providing superior classification accuracy; and (4) Conclusions: Prediction results show the efficacy of the proposed deep learning approach in bone metastasis diagnosis for breast cancer patients in nuclear medicine.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Radiomics and Machine Learning in Medical Imaging · Medical Imaging Techniques and Applications · AI in cancer detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Former Nursing Department, University of Thessaly, 35100 Lamia, Greece

Faculty of Technology, University of Thessaly, Geopolis Campus, Larissa—Trikala Ring Road, 41500 Larissa, Greece

Institute for Bio-economy and Agri-technology (iBO), Center for Research and Technology—Hellas (CERTH), 57001 Thessaloniki, Greece

Department of Computer Science, University of Thessaly, 35131 Lamia, Greece

Faculty of Technology, Geopolis Campus, University of Thessaly, 41500 Larissa, Greece

References (95)

Show source-provided references
1. Mechanisms of bone metastasis10.1056/NEJMra030831 ↗
2. Metastatic bone disease: Clinical features, pathophysiology and treatment strategies10.1053/ctrv.2000.0210 ↗
3. Bone Metastases: An Overview
4. Battafarano, G., Rossi, M., Marampon, F., and Del Fattore, A. (2005). Management of bone metastases in cancer: A review. Crit. Rev. Oncol. Hematol. Int. J. Mol. Sci.
5. Manders, K., van de Poll-Franse, L.V., Creemers, G.J., Vreugdenhil, G., van der Sangen, M.J., Nieuwenhuijzen, G.A., Roumen, R.M., and Voogd, A.C. (2006). Clinical management of women with metastatic breast cancer: A descriptive study according to age group. BMC Cancer, 6.10.1186/1471-2407-6-179 ↗
6. Yazdani, A., Dorri, S., Atashi, A., Shirafkan, H., and Zabolinezhad, H. (2019). Bone Metastasis Prognostic Factors in Breast Cancer. Breast Cancer, 13.10.1177/1178223419830978 ↗
7. Clinical features of metastatic bone disease and risk of skeletal morbidity10.1158/1078-0432.CCR-06-0931 ↗
8. Awareness and current knowledge of breast cancer10.1186/s40659-017-0140-9 ↗
9. Diagnosis of bone metastasis: Recent comparative studies of imaging modalities
10. Imaging of bone metastasis: An update10.4329/wjr.v7.i8.202 ↗
11. Comparison of the diagnostic accuracy of 99 m-Tc-MDP bone scintigraphy and 18 F-FDG PET/CT for the detection of skeletal metastases10.1177/0284185114564438 ↗
12. Bone scintigraphy and the added value of SPECT (single photon emission tomography) in detecting skeletal lesions
13. The role of SPECT/CT in skeletal malignancies10.1055/s-0034-1371019 ↗
14. Conventional imaging and computerized tomography in diagnosis of skeletal metastases
15. Review—Bone imaging in metastatic breast cancer10.1200/JCO.2004.08.181 ↗
16. The EANM practice guidelines for bone scintigraphy10.1007/s00259-016-3415-4 ↗
17. The detection of bone metastases in patients with high-risk prostate cancer: 99mTc-MDP Planar bone scintigraphy, single- and multi-field-of-view SPECT, 18F-fluoride PET, and 18F-fluoride PET/CT
18. Comparison of FDG-PET/CT and bone scintigraphy for detection of bone metastases in breast cancer10.1258/AR.2011.100507 ↗
19. Comparison of diagnostic certainty and accuracy of 18F-NaF PET/CT and planar 99mTc-MDP bone scan in patients with prostate cancer
20. Machine Learning for Computer-aided Diagnosis
21. Suzuki, K. (2012). Machine Learning in Computer-Aided Diagnosis: Medical Imaging Intelligence and Analysis: 9781466600591: Medicine & Healthcare Books, University of Chicago.10.4018/978-1-46660-059-1 ↗
22. A survey on deep learning in medical image analysis10.1016/j.media.2017.07.005 ↗
23. State-of-the-art review on deep learning in medical imaging10.2741/4725 ↗
24. Deep Learning in Medical Image Analysis10.1146/annurev-bioeng-071516-044442 ↗
25. Sahiner, B., Pezeshk, A., Hadjiiski, L.M., Wang, X., Drukker, K., Cha, K.H., Summers, R.M., and Giger, M.L. (2019). Deep learning in medical imaging and radiation therapy. Med. Phys., 46.10.1002/mp.13264 ↗
26. An overview of deep learning in medical imaging focusing on MRI10.1016/j.zemedi.2018.11.002 ↗
27. Yang, L., Xie, X., Li, P., Zhang, D., and Zhang, L. (2017, January 17–20). Part-based convolutional neural network for visual recognition. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8296586 ↗
28. Computer-Aided Diagnosis Based on Convolutional Neural Network System for Colorectal Polyp Classification: Preliminary Experience10.1159/000481227 ↗
29. Medical Image Analysis using Convolutional Neural Networks: A Review10.1007/s10916-018-1088-1 ↗
30. Convolutional neural networks for computer-aided detection or diagnosis in medical image analysis: An overview10.3934/mbe.2019326 ↗
31. Zeiler, M.D., and Fergus, R. (2014). Visualizing and understanding convolutional networks. European Conference on Computer Vision, Springer.10.1007/978-3-319-10590-1_53 ↗
32. Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). ImageNet Classification with Deep Convolutional Neural Networks, Curran Associates, Inc.. Advances in Neural Information Processing Systems 25.
33. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
34. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
35. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2016, January 21–26). Densely connected convolutional networks. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, Hawaii.10.1109/CVPR.2017.243 ↗
36. Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2016). Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. arXiv.
37. Involvement of Machine Learning for Breast Cancer Image Classification: A Survey10.1155/2017/3781951 ↗
38. Approaches for automated detection and classification of masses in mammograms10.1016/j.patcog.2005.07.006 ↗
39. A survey on the preprocessing techniques of mammogram for the detection of breast cancer
40. Jiang, Y., Chen, L., Zhang, H., and Xiao, X. (2019). Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module. PLoS ONE., 14.10.1371/journal.pone.0214587 ↗
41. Ensemble of convolutional neural networks for classification of breast microcalcification from mammograms
42. A review of computer-aided diagnosis of breast cancer: Toward the detection of subtle signs10.1016/j.jfranklin.2006.09.003 ↗
43. Identification of mammography anomalies for breast cancer detection by an ensemble of classification models based on artificial immune system10.1016/j.knosys.2016.02.019 ↗
44. Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review10.1016/j.cmpb.2017.12.012 ↗
45. Breast Cancer Detection and Diagnosis Using Mammographic Data: Systematic Review10.2196/14464 ↗
46. Munir, K., Elahi, H., Ayub, A., Frezza, F., and Rizzi, A. (2019). Cancer Diagnosis Using Deep Learning: A Bibliographic Review. Cancers, 11.10.3390/cancers11091235 ↗
47. Deep Convolutional Neural Networks for breast cancer screening10.1016/j.cmpb.2018.01.011 ↗
48. Deep convolutional neural networks for mammography: Advances, challenges and applications10.1186/s12859-019-2823-4 ↗
49. (2019, November 10). CNNs Applied in Breast Cancer Classification. Available online: https://towardsdatascience.com/convolutional-neural-network-for-breast-cancer-classification-52f1213dcc9.
50. Kumar, K., and Chandra Sekhara Rao, A. (2018, January 15–17). Breast cancer classification of image using convolutional neural network. Proceedings of the 2018 4th International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, India. Available online: https://ieeexplore.ieee.org/abstract/document/8389034.10.1109/RAIT.2018.8389034 ↗
51. Suzuki, S., Zhang, X., Homma, N., Ichiji, K., Sugita, N., Kawasumi, Y., Ishibashi, T., and Yoshizawa, M. (2016, January 20–23). Mass detection using deep convolutional neural networks for mammoghraphic computer-aided diagnosis. Proceedings of the 55th Annual Conference of the Society of Intruments and Control Engineers of Japan (SICE), Tsukuba, Japan.10.1109/SICE.2016.7749265 ↗
52. Spanhol, F.A., Oliveira, L.S., Petitjean, C., and Heutte, L. (2016, January 24–29). Breast cancer histopathological image classification using convolutional neural networks. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.10.1109/IJCNN.2016.7727519 ↗
53. Wichakam, I., and Vateekul, P. (2016, January 3–6). Combining deep convolutional networks and SVMs for mass detection on digital mammograms. Proceedings of the 8th International Conference on Knowledge and Smart Technology (KST), Bangkok, Thailand.10.1109/KST.2016.7440527 ↗
54. Swiderski, B., Kurek, J., Osowski, S., Kruk, M., and Barhoumi, W. (2017, January 8). Deep learning and non-negative matrix factorization in recognition of mammograms. Proceedings of the Eighth International Conference on Graphic and Image Processing, International Society of Optics and Photonics, Tokyo, Japan.10.1117/12.2266335 ↗
55. Unsupervised deep learning applied to breast density segmentation and mammographic risk scoring10.1109/TMI.2016.2532122 ↗
56. Giger, M.L., Vybomy, C.L., Huo, Z., and Kupinski, M.A. (2000). Computer-aided diagnosis in mammography. Handbook of Medical Imaging, Breast Cancer Detection and Diagnosis Using Mammographic Data: Systematic Review; SPIE Digital Library. [2nd ed.].
57. Influence of computer-aided detection on performance of screening mammography10.1056/NEJMoa066099 ↗
58. Lymph Node Metastasis Prediction from Primary Breast Cancer US Images Using Deep Learning10.1148/radiol.2019190372 ↗
59. Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer10.1097/PAS.0000000000001151 ↗
60. Comparison of FDG PET and SPECT for Detection of Bone Metastases in Breast Cancer
61. Prognostic utility of FDG PET/CT and bone scintigraphy in breast cancer patients with bone-only metastasis10.1097/MD.0000000000008985 ↗
62. Diagnostic methods for detection of bone metastases
63. CADBOSS: A computer-aided diagnosis system for whole-body bone scintigraphy scans10.4103/0973-1482.150422 ↗
64. Sadik, M. (2019). Computer-Assisted Diagnosis for the Interpretation of Bone Scintigraphy: A New Approach to Improve Diagnostic Accuracy. [Ph.D. Thesis, University of Gothenburg].
65. Positron emission tomography and bone metastases10.1053/j.semnuclmed.2004.11.005 ↗
66. More advantages in detecting bone and soft tissue metastases from prostate cancer using 18F-PSMA PET/CT
67. Newberg, A. (2011). Bone Scans. Radiology Secrets Plus, Elsevier. [3rd ed.].10.1016/B978-0-323-06794-2.00054-7 ↗
68. Dang, J. (2016). Classification in Bone Scintigraphy Images Using Convolutional Neural Networks. [Master’s Thesis, Lund University].
69. Deep learning for classification of benign and malignant bone lesions in [F-18]NaF PET/CT images
70. A convolutional neural network-based system to detect malignant findings in FDG PET-CT examinations
71. Can CNN detect the location of malignant uptake on FDG PET-CT?
72. A convolutional neural network based system to prevent patient misidentification in FDG-PET examinations10.1038/s41598-019-43656-y ↗
73. Strategy to develop convolutional neural network-based classifier for diagnosis of whole-body FDG PET images
74. Gjertsson, K. (2017). Segmentation in Skeletal Scintigraphy Images Using CNNs. [Master’s Thesis, Lund University].
75. Artifacts and nonosseous, uptake in bone scintigraphy. Imaging reports of 20 cases
76. O’Shea, K.T., and Nash, R. (2019, November 12). An Introduction to Convolutional Neural Networks. Available online: https://arxiv.org/abs/1511.08458.
77. Albelwi, S., and Mahmood, A. (2017). A Framework for Designing the Architectures of Deep Convolutional Neural Networks. Entropy, 19.10.3390/e19060242 ↗
78. Springenberg, J.T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (2014). Striving for simplicity: The all convolutional net, Proceedings of ICLR-2015. arXiv.
79. Convolutional neural networks: An overview and application in radiology10.1007/s13244-018-0639-9 ↗
80. (2020, January 05). Fully Connected Layers in Convolutional Neural Networks: The Complete Guide. Available online: https://missinglink.ai/guides/convolutional-neural-networks/fully-connected-layers-convolutional-neural-networks-complete-guide/.
81. Statistical normalization and back propagation for classification10.7763/IJCTE.2011.V3.288 ↗
82. Bishop, C.M., Hart, P.E., and Stork, D.G. (2006). Pattern Recognition and Machine Learning, Springer.
83. Moustakidis, S., Christodoulo, E., Papageorgiou, E., Kokkotis, C., Papandrianos, N., and Tsaopoulos, D. (2019). Application of machine intelligence for osteoarthritis classification: A classical implementation and a quantum perspective. Quantum Mach. Intell.10.1007/s42484-019-00008-3 ↗
84. Theodoridis, S., Koutroumbas, K., and Stork, D.G. (2009). Pattern Recognition, Academic Press.
85. Labatut, V., and Cherifi, H. (2011, January 11–13). Accuracy measures for the comparison of classifiers. Proceedings of the 5th International Conference on Information Technology, Amman, Jordan.
86. Dropout: A simple way to prevent neural networks from overfitting
87. Loffe, S., and Szegedy, C. (2015, January 6–11). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France.
88. (2020, January 03). Flatten Layer What Does. Available online: https://www.google.com/search?q=flatten+layer+what+does&oq=flatten+layer+what+does&aqs=chrome.69i57j0l3.5821j0j7&sourceid=chrome&ie=UTF-8.
89. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
90. Chollet, F. (2019, December 09). “Keras.” GitHub Repository. Available online: https://github.com/fchollet/keras.
91. (2020, January 25). Google Colab, Colaboratory Cloud Environment Supported by Google. Available online: https://colab.research.google.com/.
92. Jia, D., Wei, D., Richard, S., Li-Jia, L., Kai, L., and Li, F.-F. (2009, January 20–25). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.
93. Lin, M., Chen, Q., and Yan, S. (2013). Network in Network. Proceedings in ICLR 2013. arXiv.
94. (2020, January 03). Densely Connected Convolutional Networks. Available online: https://arthurdouillard.com/post/densenet/.
95. ImageNet Large Scale Visual Recognition Challenge10.1007/s11263-015-0816-y ↗