journal article·2022-07-28Open access

An Explainable Classification Method of SPECT Myocardial Perfusion Images in Nuclear Cardiology Using Deep Learning and Grad-CAM

Nikolaos I. Papandrianos, Anna Feleki, Serafeim Moustakidis, Elpiniki I. Papageorgiou, Ioannis D. Apostolopoulos, Dimitris J. Apostolopoulos

Applied Sciences· Volume 12· Issue 15

Abstract

Background: This study targets the development of an explainable deep learning methodology for the automatic classification of coronary artery disease, utilizing SPECT MPI images. Deep learning is currently judged as non-transparent due to the model’s complex non-linear structure, and thus, it is considered a «black box», making it hard to gain a comprehensive understanding of its internal processes and explain its behavior. Existing explainable artificial intelligence tools can provide insights into the internal functionality of deep learning and especially of convolutional neural networks, allowing transparency and interpretation. Methods: This study seeks to address the identification of patients’ CAD status (infarction, ischemia or normal) by developing an explainable deep learning pipeline in the form of a handcrafted convolutional neural network. The proposed RGB-CNN model utilizes various pre- and post-processing tools and deploys a state-of-the-art explainability tool to produce more interpretable predictions in decision making. The dataset includes cases from 625 patients as stress and rest representations, comprising 127 infarction, 241 ischemic, and 257 normal cases previously classified by a doctor. The imaging dataset was split into 20% for testing and 80% for training, of which 15% was further used for validation purposes. Data augmentation was employed to increase generalization. The efficacy of the well-known Grad-CAM-based color visualization approach was also evaluated in this research to provide predictions with interpretability in the detection of infarction and ischemia in SPECT MPI images, counterbalancing any lack of rationale in the results extracted by the CNNs. Results: The proposed model achieved 93.3% accuracy and 94.58% AUC, demonstrating efficient performance and stability. Grad-CAM has shown to be a valuable tool for explaining CNN-based judgments in SPECT MPI images, allowing nuclear physicians to make fast and confident judgments by using the visual explanations offered. Conclusions: Prediction results indicate a robust and efficient model based on the deep learning methodology which is proposed for CAD diagnosis in nuclear medicine.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Radiomics and Machine Learning in Medical Imaging · AI in cancer detection · Artificial Intelligence in Healthcare and Education

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece

AIDEAS OÜ, 10117 Tallinn, Estonia

Department of Medical Physics, School of Medicine, University of Patras, 26504 Patras, Greece

Department of Nuclear Medicine, University Hospital of Patras, 26504 Rio, Greece

Funding

Hellenic Foundation for Research and Innovation (H.F.R.I.) under the “2nd Call for H.F.R.I. Research Projects to sup-port Faculty Members & Researchers”

References (42)

Show source-provided references
1. Global, Regional, and National Age-Sex Specific Mortality for 264 Causes of Death, 1980–2016: A Systematic Analysis for the Global Burden of Disease Study 201610.1016/S0140-6736(17)32152-9 ↗
2. Mendis, S., Puska, P., Norrving, B., World Health Organization, and World Heart Federation (2011). World Stroke Organization Global Atlas on Cardiovascular Disease Prevention and Control/Edited by: Shanthi Mendis, World Heart Federation.
3. Hammad, M., Alkinani, M.H., Gupta, B.B., and Abd El-Latif, A.A. (2021). Myocardial Infarction Detection Based on Deep Neural Network on Imbalanced Data. Multimed. Syst., 1–13.10.1007/s00530-020-00728-8 ↗
4. Chen, J.-J., Su, T.-Y., Chen, W.-S., Chang, Y.-H., and Lu, H.H.-S. (2021). Convolutional Neural Network in the Evaluation of Myocardial Ischemia from CZT SPECT Myocardial Perfusion Imaging: Comparison to Automated Quantification. Appl. Sci., 11.10.3390/app11020514 ↗
5. Papandrianos, N., and Papageorgiou, E. (2021). Automatic Diagnosis of Coronary Artery Disease in SPECT Myocardial Perfusion Imaging Employing Deep Learning. Appl. Sci., 11.10.3390/app11146362 ↗
6. Diagnostic Accuracy of Stress-Only Myocardial Perfusion SPECT Improved by Deep Learning10.1007/s00259-021-05202-9 ↗
7. Mostafapour, S., Gholamiankhah, F., Maroofpour, S., Momennezhad, M., Asadinezhad, M., Zakavi, S.R., and Arabi, H. (2021). Deep Learning-Based Attenuation Correction in the Image Domain for Myocardial Perfusion SPECT Imaging. arXiv.10.1109/NSS/MIC44867.2021.9875572 ↗
8. Classification Models for SPECT Myocardial Perfusion Imaging10.1016/j.compbiomed.2020.103893 ↗
9. Ntakolia, C., Diamantis, D.E., Papandrianos, N., Moustakidis, S., and Papageorgiou, E.I. (2020). A Lightweight Convolutional Neural Network Architecture Applied for Bone Metastasis Classification in Nuclear Medicine: A Case Study on Prostate Cancer Patients. Healthcare, 8.10.3390/healthcare8040493 ↗
10. Development of Convolutional Neural Networks to Identify Bone Metastasis for Prostate Cancer Patients in Bone Scintigraphy10.1007/s12149-020-01510-6 ↗
11. Deep Learning10.1038/nature14539 ↗
12. The Promise of Artificial Intelligence and Deep Learning in PET and SPECT Imaging
13. Explainable AI to Improve Acceptance of Convolutional Neural Networks for Automatic Classification of Dopamine Transporter SPECT in the Diagnosis of Clinically Uncertain Parkinsonian Syndromes10.1007/s00259-021-05569-9 ↗
14. CT-Based Attenuation Correction in Tl-201 Myocardial Perfusion Scintigraphy Is Less Effective than Non-Corrected SPECT for Risk Stratification10.1007/s12350-014-9867-7 ↗
15. An Overview of Deep Learning in Medical Imaging10.1016/j.imu.2021.100723 ↗
16. Singh, A., Sengupta, S., and Lakshminarayanan, V. (2020). Explainable Deep Learning Models in Medical Image Analysis. J. Imaging, 6.10.3390/jimaging6060052 ↗
17. XAI-Explainable Artificial Intelligence10.1126/scirobotics.aay7120 ↗
18. Clinical Deployment of Explainable Artificial Intelligence of SPECT for Diagnosis of Coronary Artery Disease
19. Deep Learning Analysis of Upright-Supine High-Efficiency SPECT Myocardial Perfusion Imaging for Prediction of Obstructive Coronary Artery Disease: A Multicenter Study10.2967/jnumed.118.213538 ↗
20. Deep Learning for Prediction of Obstructive Disease From Fast Myocardial Perfusion SPECT10.1016/j.jcmg.2018.01.020 ↗
21. Zahiri, N., Asgari, R., Razavi-Ratki, S.-K., and Parach, A.-A. (2021). Deep Learning Analysis of Polar Maps from SPECT Myocardial Perfusion Imaging for Prediction of Coronary Artery Disease. Res. Sq.10.21203/rs.3.rs-1153347/v1 ↗
22. Papandrianos, N., Feleki, A., and Papageorgiou, E. (2021, January 26). Exploring Classification of SPECT MPI Images Applying Convolutional Neural Networks. Proceedings of the 25th Pan-Hellenic Conference on Informatics, Association for Computing Machinery, New York, NY, USA.10.1145/3503823.3503911 ↗
23. Automatic Characterization of Myocardial Perfusion Imaging Polar Maps Employing Deep Learning and Data Augmentation
24. Multi-Input Deep Learning Approach for Cardiovascular Disease Diagnosis Using Myocardial Perfusion Imaging and Clinical Data
25. Machine Learning Algorithms to Distinguish Myocardial Perfusion SPECT Polar Maps10.3389/fcvm.2021.741667 ↗
26. Diagnostic Accuracy of an Artificial Neural Network Compared with Statistical Quantitation of Myocardial Perfusion Images: A Japanese Multicenter Study10.1007/s00259-017-3834-x ↗
27. Ischemic Heart Disease Detection Using Selected Machine Learning Methods
28. Diagnostic Accuracy of Deep Learning for Myocardial Perfusion Imaging in Men and Women with a High-Efficiency Parallel-Hole-Collimated Cadmium-Zinc-Telluride Camera: Multicenter Study
29. Classification of Polar Maps from Cardiac Perfusion Imaging with Graph-Convolutional Neural Networks10.1038/s41598-019-43951-8 ↗
30. Magesh, P.R., Myloth, R.D., and Tom, R.J. (2020). An Explainable Machine Learning Model for Early Detection of Parkinson’s Disease Using LIME on DaTscan Imagery. arXiv.10.1016/j.compbiomed.2020.104041 ↗
31. A Convolutional Neural Network-Based System to Prevent Patient Misidentification in FDG-PET Examinations10.1038/s41598-019-43656-y ↗
32. Using Deep Learning Techniques in Medical Imaging: A Systematic Review of Applications on CT and PET10.1007/s10462-019-09788-3 ↗
33. A Survey on Deep Learning in Medical Image Analysis10.1016/j.media.2017.07.005 ↗
34. Christodoulou, E., Moustakidis, S., Papandrianos, N., Tsaopoulos, D., and Papageorgiou, E. (2019, January 15–17). Exploring Deep Learning Capabilities in Knee Osteoarthritis Case Study for Classification. Proceedings of the IEEE 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA), Patras, Greece.10.1109/IISA.2019.8900714 ↗
35. An, J., and Joe, I. (2022). Attention Map-Guided Visual Explanations for Deep Neural Networks. Appl. Sci., 12.10.3390/app12083846 ↗
36. Lizzi, F., Scapicchio, C., Laruina, F., Retico, A., and Fantacci, M.E. (2022). Convolutional Neural Networks for Breast Density Classification: Performance and Explanation Insights. Appl. Sci., 12.10.3390/app12010148 ↗
37. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization10.1007/s11263-019-01228-7 ↗
38. Selvaraju, R.R., Das, A., Vedantam, R., Cogswell, M., Parikh, D., and Batra, D. (2017). Grad-CAM: Why Did You Say That?. arXiv.
39. Direct and Indirect Strategies of Deep-Learning-Based Attenuation Correction for General Purpose and Dedicated Cardiac SPECT10.1007/s00259-022-05718-8 ↗
40. Xiao, M., Zhang, L., Shi, W., Liu, J., He, W., and Jiang, Z. (2021, January 23). A Visualization Method Based on the Grad-CAM for Medical Image Segmentation Model. Proceedings of the IEEE 2021 International Conference on Electronic Information Engineering and Computer Science (EIECS), Changchun, China.10.1109/EIECS53707.2021.9587953 ↗
41. Machine Learning Interface for Medical Image Analysis10.1007/s10278-016-9910-0 ↗
42. Papandrianos, N.I., Feleki, A., Papageorgiou, E.I., and Martini, C. (2022). Deep Learning-Based Automated Diagnosis for Coronary Artery Disease Using SPECT-MPI Images. J. Clin. Med., 11.10.3390/jcm11133918 ↗