journal article·2022-06-19Open access

Shape-Based Breast Lesion Classification Using Digital Tomosynthesis Images: The Role of Explainable Artificial Intelligence

Sardar Mehboob Hussain, Domenico Buongiorno, Nicola Altini, Francesco Berloco, Berardino Prencipe, Marco Moschetta, Vitoantonio Bevilacqua, Antonio Brunetti

Applied Sciences· Volume 12· Issue 12

Abstract

Computer-aided diagnosis (CAD) systems can help radiologists in numerous medical tasks including classification and staging of the various diseases. The 3D tomosynthesis imaging technique adds value to the CAD systems in diagnosis and classification of the breast lesions. Several convolutional neural network (CNN) architectures have been proposed to classify the lesion shapes to the respective classes using a similar imaging method. However, not only is the black box nature of these CNN models questionable in the healthcare domain, but so is the morphological-based cancer classification, concerning the clinicians. As a result, this study proposes both a mathematically and visually explainable deep-learning-driven multiclass shape-based classification framework for the tomosynthesis breast lesion images. In this study, authors exploit eight pretrained CNN architectures for the classification task on the previously extracted regions of interests images containing the lesions. Additionally, the study also unleashes the black box nature of the deep learning models using two well-known perceptive explainable artificial intelligence (XAI) algorithms including Grad-CAM and LIME. Moreover, two mathematical-structure-based interpretability techniques, i.e., t-SNE and UMAP, are employed to investigate the pretrained models’ behavior towards multiclass feature clustering. The experimental results of the classification task validate the applicability of the proposed framework by yielding the mean area under the curve of 98.2%. The explanability study validates the applicability of all employed methods, mainly emphasizing the pros and cons of both Grad-CAM and LIME methods that can provide useful insights towards explainable CAD systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · Radiomics and Machine Learning in Medical Imaging · Medical Image Segmentation Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Information Engineering (DEI), Polytechnic University of Bari, 70126 Bari, Italy

Apulian Bioengineering s.r.l., Via delle Violette 14, 70026 Modugno, Italy

Department of Emergency and Organ Transplantation, University of Bari Medical School, Piazza Giulio Cesare 11, 70121 Bari, Italy

References (59)

Show source-provided references
1. Cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries10.3322/caac.21492 ↗
2. A systematic review of decision aids for mammography screening: Focus on outcomes and characteristics10.1016/j.ijmedinf.2021.104406 ↗
3. A review on image-based approaches for breast cancer detection, segmentation, and classification10.1016/j.eswa.2021.115204 ↗
4. Digital breast tomosynthesis: Potential benefits in routine clinical practice10.1177/08465371211025229 ↗
5. Association between imaging characteristics and different molecular subtypes of breast cancer10.1016/j.acra.2016.11.012 ↗
6. Significance and application of digital breast tomosynthesis for the BI-RADS classification of breast cancer10.7314/APJCP.2015.16.9.4109 ↗
7. Sickles, E., D’Orsi, C., and Bassett, L. (2013). ACR BI-RADS® Mammography. ACR BI-RADS® Atlas, Breast Imaging Reporting and Data System, American College of Radiology.
8. Imaging features of breast cancers on digital breast tomosynthesis according to molecular subtype: Association with breast cancer detection10.1259/bjr.20170470 ↗
9. Association between digital breast tomosynthesis and molecular subtypes of breast cancer
10. Deep learning for image-based cancer detection and diagnosis- A survey10.1016/j.patcog.2018.05.014 ↗
11. Three-dimensional virtual colonoscopy for automatic polyps detection by artificial neural network approach: New tests on an enlarged cohort of polyps10.1016/j.neucom.2012.03.026 ↗
12. Bevilacqua, V., Brunetti, A., Trotta, G.F., Dimauro, G., Elez, K., Alberotanza, V., and Scardapane, A. (2017, January 5–8). A novel approach for Hepatocellular Carcinoma detection and classification based on triphasic CT Protocol. Proceedings of the 2017 IEEE congress on evolutionary computation (CEC), Donostia, Spain.10.1109/CEC.2017.7969527 ↗
13. Bevilacqua, V., Altini, N., Prencipe, B., Brunetti, A., Villani, L., Sacco, A., Morelli, C., Ciaccia, M., and Scardapane, A. (2021). Lung Segmentation and Characterization in COVID-19 Patients for Assessing Pulmonary Thromboembolism: An Approach Based on Deep Learning and Radiomics. Electronics, 10.10.3390/electronics10202475 ↗
14. Survey on machine learning and deep learning applications in breast cancer diagnosis10.1007/s12559-020-09813-6 ↗
15. Deep and machine learning techniques for medical imaging-based breast cancer: A comprehensive review10.1016/j.eswa.2020.114161 ↗
16. Wu, J., and Hicks, C. (2021). Breast Cancer Type Classification Using Machine Learning. J. Pers. Med., 11.10.3390/jpm11020061 ↗
17. A novel deep learning based framework for the detection and classification of breast cancer using transfer learning10.1016/j.patrec.2019.03.022 ↗
18. Thermal infrared imaging based breast cancer diagnosis using machine learning techniques10.1007/s11042-020-09600-3 ↗
19. A framework for breast cancer classification using multi-DCNNs10.1016/j.compbiomed.2021.104245 ↗
20. Application of decision tree-based ensemble learning in the classification of breast cancer10.1016/j.compbiomed.2020.104089 ↗
21. Improved breast cancer classification through combining graph convolutional network and convolutional neural network10.1016/j.ipm.2020.102439 ↗
22. An automatic Computer-Aided Diagnosis system based on the Multimodal fusion of Breast Cancer (MF-CAD)10.1016/j.bspc.2021.102914 ↗
23. Shi, J., Vakanski, A., Xian, M., Ding, J., and Ning, C. (2022). EMT-NET: Efficient multitask network for computer-aided diagnosis of breast cancer. arXiv.10.1109/ISBI52829.2022.9761438 ↗
24. An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization10.1016/j.media.2020.101908 ↗
25. Saffari, N., Rashwan, H.A., Abdel-Nasser, M., Kumar Singh, V., Arenas, M., Mangina, E., Herrera, B., and Puig, D. (2020). Fully Automated Breast Density Segmentation and Classification Using Deep Learning. Diagnostics, 10.10.3390/diagnostics10110988 ↗
26. Breast tumor detection and classification based on density10.1007/s11042-020-09220-x ↗
27. Kopans, D. (1989). Mammography, Breast Imaging, JB Lippincott Company.
28. Kisilev, P., Sason, E., Barkan, E., and Hashoul, S. (2016). Medical image description using multi-task-loss CNN. Deep Learning and Data Labeling for Medical Applications, Springer.10.1007/978-3-319-46976-8_13 ↗
29. Breast tumor segmentation and shape classification in mammograms using generative adversarial and convolutional neural network10.1016/j.eswa.2019.112855 ↗
30. Kim, S.T., Lee, H., Kim, H.G., and Ro, Y.M. (2018, January 10–15). ICADx: Interpretable computer aided diagnosis of breast masses. Proceedings of the Medical Imaging 2018: Computer-Aided Diagnosis, Houston, TX, USA.10.1117/12.2293570 ↗
31. Samek, W., Montavon, G., Vedaldi, A., Hansen, L.K., and Müller, K.R. (2019). Explainable AI: Interpreting, Explaining and Visualizing Deep Learning, Springer Nature.10.1007/978-3-030-28954-6 ↗
32. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead10.1038/s42256-019-0048-x ↗
33. Gulum, M.A., Trombley, C.M., and Kantardzic, M. (2021). A Review of Explainable Deep Learning Cancer Detection Models in Medical Imaging. Appl. Sci., 11.10.3390/app11104573 ↗
34. A survey on explainable artificial intelligence (xai): Toward medical xai10.1109/TNNLS.2020.3027314 ↗
35. Unbox the black-box for the medical explainable ai via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond10.1016/j.inffus.2021.07.016 ↗
36. Suh, Y.J., Jung, J., and Cho, B.J. (2020). Automated breast cancer detection in digital mammograms of various densities via deep learning. J. Pers. Med., 10.10.3390/jpm10040211 ↗
37. A deep learning classifier for digital breast tomosynthesis10.1016/j.ejmp.2021.03.021 ↗
38. Sickles, E.A., D’Orsi, C.J., Bassett, L.W., Appleton, C.M., Berg, W.A., Burnside, E.S., Mendelson, E.B., Morris, E.A., Creech, W.E., and Butler, P.F. (2013). ACR BI-RADS® Atlas, Breast Imaging Reporting and Data System, American College of Radiology.
39. A performance comparison between shallow and deeper neural networks supervised classification of tomosynthesis breast lesions images10.1016/j.cogsys.2018.04.011 ↗
40. Digital mammography versus digital mammography plus tomosynthesis in breast cancer screening: The Oslo Tomosynthesis Screening Trial10.1148/radiol.2019182394 ↗
41. Digital breast tomosynthesis versus digital mammography: Integration of image modalities enhances deep learning-based breast mass classification10.1007/s00330-019-06457-5 ↗
42. Transfer learning from convolutional neural networks for computer-aided diagnosis: A comparison of digital breast tomosynthesis and full-field digital mammography10.1016/j.acra.2018.06.019 ↗
43. Evolutionary pruning of transfer learned deep convolutional neural network for breast cancer diagnosis in digital breast tomosynthesis10.1088/1361-6560/aabb5b ↗
44. Fotin, S.V., Yin, Y., Haldankar, H., Hoffmeister, J.W., and Periaswamy, S. (March, January 27). Detection of soft tissue densities from digital breast tomosynthesis: Comparison of conventional and deep learning approaches. Proceedings of the Medical Imaging 2016: Computer-Aided Diagnosis. International Society for Optics and Photonics, San Diego, CA, SUA.10.1117/12.2217045 ↗
45. Enhancement accuracy of breast tumor diagnosis in digital mammograms10.4172/2254-609X.100072 ↗
46. A method for the automated classification of benign and malignant masses on digital breast tomosynthesis images using machine learning and radiomic features10.1007/s12194-019-00543-5 ↗
47. A new computer-aided diagnosis system with modified genetic feature selection for bi-RADS classification of breast masses in mammograms10.1155/2020/7695207 ↗
48. Masud, M., Eldin Rashed, A.E., and Hossain, M.S. (2020). Convolutional neural network-based models for diagnosis of breast cancer. Neural Comput. Appl., 1–12.10.1007/s00521-020-05394-5 ↗
49. MGBN: Convolutional neural networks for automated benign and malignant breast masses classification10.1007/s11042-021-10929-6 ↗
50. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
51. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
52. Xie, S., Girshick, R., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.634 ↗
53. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
54. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–22). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
55. Das, A., and Rad, P. (2020). Opportunities and challenges in explainable artificial intelligence (xai): A survey. arXiv.
56. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗
57. Visualizing Data using t-SNE
58. McInnes, L., Healy, J., and Melville, J. (2018). Umap: Uniform manifold approximation and projection for dimension reduction. arXiv.10.21105/joss.00861 ↗
59. Meta-AI (2021, December 05). PyTorch Transforms. Available online: https://pytorch.org/vision/stable/transforms.html.