journal article·2022-04-07Open access

Deep Learning Applied to Chest Radiograph Classification—A COVID-19 Pneumonia Experience

Adhvan Furtado, Leandro Andrade, Diego Frias, Thiago Maia, Roberto Badaró, Erick G. Sperandio Nascimento

Applied Sciences· Volume 12· Issue 8

Abstract

Due to the recent COVID-19 pandemic, a large number of reports present deep learning algorithms that support the detection of pneumonia caused by COVID-19 in chest radiographs. Few studies have provided the complete source code, limiting testing and reproducibility on different datasets. This work presents Cimatec_XCOV19, a novel deep learning system inspired by the Inception-V3 architecture that is able to (i) support the identification of abnormal chest radiographs and (ii) classify the abnormal radiographs as suggestive of COVID-19. The training dataset has 44,031 images with 2917 COVID-19 cases, one of the largest datasets in recent literature. We organized and published an external validation dataset of 1158 chest radiographs from a Brazilian hospital. Two experienced radiologists independently evaluated the radiographs. The Cimatec_XCOV19 algorithm obtained a sensitivity of 0.85, specificity of 0.82, and AUC ROC of 0.93. We compared the AUC ROC of our algorithm with a well-known public solution and did not find a statistically relevant difference between both performances. We provide full access to the code and the test dataset, enabling this work to be used as a tool for supporting the fast screening of COVID-19 on chest X-ray exams, serving as a reference for educators, and supporting further algorithm enhancements.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: COVID-19 diagnosis using AI · Radiology practices and education · Dental Research and COVID-19

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Super Computing Center SENAI/CIMATEC, Av. Orlando Gomes, 1845, Piatã, Salvador 41560-010, Brazil

Escola de Administração, Universidade Federal da Bahia, Avenida Reitor Miguel Calmon s/n Vale do-Canela, Salvador 40110-903, Brazil

Department of Natural and Earth Sciences, Universidade do Estado da Bahia, Rua Silveira Martins, 2555, Cabula 41150-000, Brazil

SAMEDIL—Serviços de Atendimento Médico, Rua Pedro Fonseca, 170-Monte Belo, Vitória 29053-280, Brazil

Instituto SENAI de Inovação em Saúde, Av. Orlando Gomes, 1845, Piatã, Salvador 41560-010, Brazil

Funding

ABDI, SENAI, EMBRAPII, REPSOL SINOPEC BRASIL

References (39)

Show source-provided references
1. A Novel Coronavirus from Patients with Pneumonia in China, 201910.1056/NEJMoa2001017 ↗
2. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China10.1016/S0140-6736(20)30183-5 ↗
3. Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases10.1148/radiol.2020200642 ↗
4. The role of imaging in 2019 novel coronavirus pneumonia (COVID-19)10.1007/s00330-020-06827-4 ↗
5. SARS-CoV-2 Omicron variant replication in human bronchus and lung ex vivo10.1038/s41586-022-04479-6 ↗
6. Role of computed tomography in COVID-1910.1016/j.jcct.2020.08.013 ↗
7. Use of Chest Imaging in the Diagnosis and Management of COVID-19: A WHO Rapid Advice Guide10.1148/radiol.2020203173 ↗
8. The Role of Chest Imaging in Patient Management during the COVID-19 Pandemic: A Multinational Consensus Statement from the Fleischner Society10.1148/radiol.2020201365 ↗
9. Radiological Society of North America Expert Consensus Statement on Reporting Chest CT Findings Related to COVID-19. Endorsed by the Society of Thoracic Radiology, the American College of Radiology, and RSNA—Secondary Publication10.1097/RTI.0000000000000524 ↗
10. Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: A descriptive study10.1016/S1473-3099(20)30086-4 ↗
11. Rahman, S., Sarker, S., Al Miraj, A., Nihal, R.A., Haque, A.K.M.N., and Al Noman, A. (2021). Deep Learning–Driven Automated Detection of COVID-19 from Radiography Images: A Comparative Analysis. Cogn. Comput.10.20944/preprints202008.0215.v2 ↗
12. Use of Conventional Chest Imaging and Artificial Intelligence in COVID-19 Infection. A Review of the Literature10.1016/j.opresp.2020.100078 ↗
13. New bag of deep visual words based features to classify chest x-ray images for COVID-19 diagnosis10.1007/s13755-021-00152-w ↗
14. Fusion of multi-scale bag of deep visual words features of chest X-ray images to detect COVID-19 infection10.1038/s41598-021-03287-8 ↗
15. Attention-based VGG-16 model for COVID-19 chest X-ray image classification10.1007/s10489-020-02055-x ↗
16. Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans10.1038/s42256-021-00307-0 ↗
17. On the role of artificial intelligence in medical imaging of COVID-1910.1016/j.patter.2021.100269 ↗
18. Current limitations to identify COVID-19 using artificial intelligence with chest X-ray imaging10.1007/s12553-021-00520-2 ↗
19. A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and COVID-19 pneumonia from chest X-ray images10.1038/s41551-021-00704-1 ↗
20. DeepCOVID-XR: An Artificial Intelligence Algorithm to Detect COVID-19 on Chest Radiographs Trained and Tested on a Large U.S. Clinical Data Set10.1148/radiol.2020203511 ↗
21. Prognostication of patients with COVID-19 using artificial intelligence based on chest x-rays and clinical data: A retrospective study10.1016/S2589-7500(21)00039-X ↗
22. COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images10.1038/s41598-020-76550-z ↗
23. Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks10.1007/s10044-021-00984-y ↗
24. Automated detection of COVID-19 cases using deep neural networks with X-ray images10.1016/j.compbiomed.2020.103792 ↗
25. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the Inception Architecture for Computer Vision. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
26. An overview of deep learning in medical imaging10.1016/j.imu.2021.100723 ↗
27. (2022, February 12). RSNA Pneumonia Detection Challenge. Available online: https://www.rsna.org/education/ai-resources-and-training/ai-image-challenge/RSNA-Pneumonia-Detection-Challenge-2018.
28. PadChest: A large chest x-ray image dataset with multi-label annotated reports10.1016/j.media.2020.101797 ↗
29. De la Iglesia Vayá, M., Saborit, J.M., Montell, J.A., Pertusa, A., Bustos, A., Cazorla, M., Galant, J., Barber, X., Orozco-Beltrán, D., and García-García, F. (2022, February 12). BIMCV COVID-19+: A Large Annotated Dataset of RX and CT Images from COVID-19 Patients. Available online: https://arxiv.org/abs/2006.01174v3.
30. Cohen, J.P., Morrison, P., Dao, L., Roth, K., Duong, T.Q., and Ghassemi, M. (2022, February 20). COVID-19 Image Data Collection: Prospective Predictions Are the Future. Available online: https://github.com/ieee8023/covid-chestxray-dataset.
31. Montavon, G., Orr, G.B., and Müller, K.R. (2012). Efficient BackProp. Neural Networks: Tricks of the Trade. Lecture Notes in Computer Science, Springer.10.1007/978-3-642-35289-8 ↗
32. The Effect of Image Resolution on Deep Learning in Radiography10.1148/ryai.2019190015 ↗
33. The Measurement of Observer Agreement for Categorical Data10.2307/2529310 ↗
34. (2020, December 10). Cimatec_XCOV19 Git Page. Available online: https://github.com/CRIA-CIMATEC/covid-19.
35. Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach10.2307/2531595 ↗
36. Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning
37. Winston, J., Jackson, D., Wozniak, D., Zeisler, J., Farish, S., and Thoma, P. (2001). Quality Control recommendations for diagnostic radiography volume 3 radiographic or fluoroscopic. Radiographic or Fluoroscopic Machines, CRCPD Publication.
38. Zhou, J., Jing, B., Wang, Z., Xin, H., and Tong, H. (2021). SODA: Detecting COVID-19 in Chest X-rays with Semi-supervised Open Set Domain Adaptation. IEEE/ACM Trans. Comput. Biol. Bioinform.10.1109/TCBB.2021.3066331 ↗
39. Rajpurkar, P., Joshi, A., Pareek, A., Ng, A.Y., and Lungren, M.P. (2021, January 8–9). CheXternal: Generalization of deep learning models for chest X-ray interpretation to photos of chest X-rays and external clinical settings. Proceedings of the Conference on Health, Inference, and Learning, Virtual.10.1145/3450439.3451876 ↗