journal article·2024Open access

Explainable Conformer Network for Detection of COVID-19 Pneumonia from Chest CT Scan: From Concepts toward Clinical Explainability

Mohamed Abdel-Basset, Hossam Hawash, Mohamed Abouhawwash, S. S. Askar, Alshaimaa A. Tantawy

Computers, Materials & Continua· Volume 78· Issue 1

Abstract

The early implementation of treatment therapies necessitates the swift and precise identification of COVID-19 pneumonia by the analysis of chest CT scans. This study aims to investigate the indispensable need for precise and interpretable diagnostic tools for improving clinical decision-making for COVID-19 diagnosis. This paper proposes a novel deep learning approach, called Conformer Network, for explainable discrimination of viral pneumonia depending on the lung Region of Infections (ROI) within a single modality radiographic CT scan. Firstly, an efficient U-shaped transformer network is integrated for lung image segmentation. Then, a robust transfer learning technique is introduced to design a robust feature extractor based on pre-trained lightweight Big Transfer (BiT-L) and finetuned on medical data to effectively learn the patterns of infection in the input image. Secondly, this work presents a visual explanation method to guarantee clinical explainability for decisions made by Conformer Network. Experimental evaluation of real-world CT data demonstrated that the diagnostic accuracy of our model outperforms cutting-edge studies with statistical significance. The Conformer Network achieves 97.40% of detection accuracy under cross-validation settings. Our model not only achieves high sensitivity and specificity but also affords visualizations of salient features contributing to each classification decision, enhancing the overall transparency and trustworthiness of our model. The findings provide obvious implications for the ability of our model to empower clinical staff by generating transparent intuitions about the features driving diagnostic decisions.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: COVID-19 diagnosis using AI · Radiomics and Machine Learning in Medical Imaging · AI in cancer detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (45)

Show source-provided references
1. New insights on the antiviral effects of chloroquine against coronavirus: What to expect for COVID-1910.1016/j.ijantimicag.2020.105938 ↗
2. Coronavirus infections reported by proMED, February 2000–January 202010.1016/j.tmaid.2020.101575 ↗
3. The reproductive number of COVID-19 is higher compared to SARS coronavirus
4. An analysis of obesity in school children during the pandemic COVID-19 using plithogenic single valued fuzzy sets10.61356/j.nswa.2023.51 ↗
5. Emerging 2019 novel coronavirus (2019-nCoV) pneumonia10.1148/radiol.2020200274 ↗
6. Performance of radiologists in differentiating COVID-19 from viral pneumonia on chest CT
7. Knowledge-based analysis for mortality prediction from CT images10.1109/JBHI.2019.2946066 ↗
8. Spectral differential phase contrast x-ray radiography10.1109/TMI.2019.2932450 ↗
9. Sensitivity of chest CT for COVID-19: Comparison to RT-PCR
10. Co-learning feature fusion maps from PET-CT images of lung cancer10.1109/TMI.2019.2923601 ↗
11. CT Super-resolution GAN constrained by the identical residual and cycle learning ensemble10.1109/TMI.2019.2922960 ↗
12. Thorax-Net: An attention regularized deep neural network for classification of thoracic diseases on chest radiography10.1109/JBHI.2019.2928369 ↗
13. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: A report of 1014 cases
14. A deep learning algorithm using CT images to screen for corona virus disease (COVID-19)
15. O. Gozes, M. Adar, H. Greenspan, P. Browning, H. Zhang et al., “Rapid AI development cycle for the coronavirus (COVID-19) pandemic: Initial results for automated detection & patient monitoring using deep learning CT image analysis,” arXiv preprint arXiv:2003.05037, vol. 12, no. 7, pp. 1–20, 2020.
16. Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT
17. M. Aghbolaghi, R. Azad, M. Fathy and S. Escalera, “Multi-level context gating of embedded collective knowledge for medical image segmentation,” arXiv preprint arXiv:2003.05056, vol. 4, no. 5, pp. 1–20, 2020.
18. An improved U-net convolutional networks for seabed mineral image segmentation10.1109/ACCESS.2019.2923753 ↗
19. NAS-Unet: Neural architecture search for medical image segmentation10.1109/ACCESS.2019.2908991 ↗
20. Deep residual learning for image recognition
21. ImageNet large scale visual recognition challenge10.1007/s11263-015-0816-y ↗
22. X. Xu, X. Jiang, C. Ma, P. Du, X. Li et al., “Deep learning system to screen coronavirus disease 2019 pneumonia,” arXiv preprint arXiv:2002.09334, vol. 6, no. 5, pp. 1–22, 2020.10.1016/j.eng.2020.04.010 ↗
23. Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images
24. A. Narin, C. Kaya and Z. Pamuk, “Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks,” arXiv preprint arXiv:2003.10849, vol. 20, no. 4, pp. 1–17, 2020.
25. UNet++: Redesigning skip connections to exploit multiscale features in image segmentation
26. Squeeze-and-excitation networks
27. Densely connected convolutional networks
28. Batch normalization: Accelerating deep network training by reducing internal covariate shift
29. A generative adversarial gated recurrent unit model for precipitation nowcasting10.1109/LGRS.2019.2926776 ↗
30. A. Kolesnikov, L. Beyer, X. Zhai, J. Puigcerver, J. Yung et al., “Large scale learning of general visual representations for transfer,” arXiv preprint arXiv:1912.11370, vol. 4, no. 3, pp. 1–15, 2019.
31. M. Tan and Q. V. Le, “EfficientNet: Rethinking model scaling for convolutional neural networks,” arXiv preprint arXiv:1905.11946, vol. 12, no. 4, pp. 1–24, 2019.
32. Q. Xie, E. Hovy, M. Luong and Q. Le, “Self-training with noisy student improves ImageNet classification,” arXiv preprint arXiv:1911.04252, vol. 23, no. 7, pp. 1–15, 2019.
33. The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans10.1118/1.3528204 ↗
34. Labeled optical coherence tomography (oct) and chest X-ray images for classification
35. Pairwise Gaussian loss for convolutional neural networks
36. CE-Net: Context encoder network for 2D medical image segmentation
37. M. Alom, M. Hasan, C. Yakopcic, T. Taha and V. Asari, “Recurrent residual convolutional neural network based on U-Net (R2U-Net) for medical image segmentation,” arXiv preprint arXiv:1802.06955, vol. 11, no. 4, pp. 1–10, 2018.10.1109/NAECON.2018.8556686 ↗
38. Convolutional two stream network fusion for video action recognition
39. Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks
40. J. Chen, Y. Y. Lu, Q. Yu, X. Luo, E. Adeli et al., “TransUNet: Transformers make strong encoders for medical image segmentation,” arXiv preprint arXiv:2102.04306, vol. 23, no. 3, pp. 1–15, 2021.
41. C. Hu, Y. Wang, J. Chen, D. Jiang, X. Zhang et al., “Swin-Unet: Unet-like pure transformer for medical image segmentation,” arXiv preprint arXiv:2105.05537, vol. 4, no. 23, pp. 1–17, 2021.
42. DeepHAR-Net: A novel machine intelligence approach for human activity recognition from inertial sensors10.61185/SMIJ.2022.8463 ↗
43. A cloud-based model for driver drowsiness detection and prediction based on facial expressions and activities10.4018/IJCAC.312565 ↗
44. Breaking the silence: Convolutional neural networks for sign language recognition in the deaf community10.61185/SMIJ.2022.7844 ↗
45. A novel approach based on marine predators algorithm for medical image enhancement10.1007/s11220-023-00411-y ↗