journal article·2021-07-29Open access

Prediction of COVID-19 from Chest CT Images Using an Ensemble of Deep Learning Models

Shreya Biswas, Somnath Chatterjee, Arindam Majee, Shibaprasad Sen, Friedhelm Schwenker, Ram Sarkar

Applied Sciences· Volume 11· Issue 15

Abstract

The novel SARS-CoV-2 virus, responsible for the dangerous pneumonia-type disease, COVID-19, has undoubtedly changed the world by killing at least 3,900,000 people as of June 2021 and compromising the health of millions across the globe. Though the vaccination process has started, in developing countries such as India, the process has not been fully developed. Thereby, a diagnosis of COVID-19 can restrict its spreading and level the pestilence curve. As the quickest indicative choice, a computerized identification framework ought to be carried out to hinder COVID-19 from spreading more. Meanwhile, Computed Tomography (CT) imaging reveals that the attributes of these images for COVID-19 infected patients vary from healthy patients with or without other respiratory diseases, such as pneumonia. This study aims to establish an effective COVID-19 prediction model through chest CT images using efficient transfer learning (TL) models. Initially, we used three standard deep learning (DL) models, namely, VGG-16, ResNet50, and Xception, for the prediction of COVID-19. After that, we proposed a mechanism to combine the above-mentioned pre-trained models for the overall improvement of the prediction capability of the system. The proposed model provides 98.79% classification accuracy and a high F1-score of 0.99 on the publicly available SARS-CoV-2 CT dataset. The model proposed in this study is effective for the accurate screening of COVID-19 CT scans and, hence, can be a promising supplementary diagnostic tool for the forefront clinical specialists.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: COVID-19 diagnosis using AI · Radiomics and Machine Learning in Medical Imaging · AI in cancer detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electronics and Telecommunication Engineering, Jadavpur University, Kolkata 700032, India

Department of Computer Science and Engineering, Future Institute of Engineering and Management, Kolkata 700150, India

Department of Computer Science and Engineering, University of Engineering and Management, Kolkata 700160, India

Institute of Neural Information Processing, Ulm University, 89069 Ulm, Germany

Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India

References (61)

Show source-provided references
1. (2021, May 17). Available online: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/naming-the-coronavirus-disease-(covid-2019)-and-the-virus-that-causes-it.
2. (2021, May 17). Available online: https://www.who.int/emergencies/diseases/novel-coronavirus-2019.
3. Real-time reverse transcription-polymerase chain reaction assay for SARS-associated coronavirus10.3201/eid1002.030759 ↗
4. (2021, June 29). Available online: https://www.who.int/news-room/articles-detail/sars-cov-2-antigen-detecting-rapid-diagnostic-test-implementation-projects.
5. Classification of COVID-19 patients from chest CT images using multi-objective differential evolution-based convolutional neural networks10.1007/s10096-020-03901-z ↗
6. Three-stage network for age estimation10.1049/trit.2019.0017 ↗
7. Wang, S., Kang, B., Ma, J., Zeng, X., Xiao, M., Guo, J., Cai, M., Yang, J., Li, Y., and Meng, X. (2020). A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19). medRxiv.10.1101/2020.02.14.20023028 ↗
8. Elaziz, M.A., Hosny, K.M., Salah, A., Darwish, M.M., Lu, S., and Sahlol, A.T. (2020). New machine learning method for image-based diagnosis of COVID-19. PLoS ONE, 15.10.1371/journal.pone.0235187 ↗
9. Deep learning10.1038/nature14539 ↗
10. Distinctive Image Features from Scale-Invariant Keypoints10.1023/B:VISI.0000029664.99615.94 ↗
11. Winder, S.A.J., and Brown, M. (2007, January 17–22). Learning local image descriptors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.382971 ↗
12. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
13. Deng, L., Li, J., Huang, J.T., Yao, K., Yu, D., Seide, F., Seltzer, M., Zweig, G., He, X., and Williams, J. (2013, January 26–31). Recent advances in deep learning for speech research at Microsoft. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.10.1109/ICASSP.2013.6639345 ↗
14. Torfi, A., Shirvani, R.A., Keneshloo, Y., Tavvaf, N., and Fox, E. (2020). Natural Language Processing Advancements by Deep Learning: A Survey. arXiv.
15. Deep learning to distinguish recalled but benign mammography images in breast cancer screening10.1158/1078-0432.CCR-18-1115 ↗
16. Hybrid deep learning for detecting lung diseases from X-ray images10.1016/j.imu.2020.100391 ↗
17. A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia10.1016/j.eng.2020.04.010 ↗
18. An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare10.1155/2019/4180949 ↗
19. Seizure prediction—Ready for a new era10.1038/s41582-018-0055-2 ↗
20. Building predictive models for MERS-CoV infections using data mining techniques10.1016/j.jiph.2016.09.007 ↗
21. Mateos, P.A., Balboa, R.F., Easteal, S., Eyras, E., and Patel, H.R. (2020). PACIFIC: A lightweight deep-learning classifier of SARS-CoV-2 and co-infecting RNA viruses. Sci. Rep.10.1101/2020.07.24.219097 ↗
22. KDEEP: Protein-Ligand Absolute Binding Affinity Prediction via 3D-Convolutional Neural Networks10.1021/acs.jcim.7b00650 ↗
23. Ghadezadeh, M., and Asadi, F. (2021). Deep Learning in the Detection and Diagnosis of COVID-19 Using Radiology Modalities: A Systematic Review. J. Healthc. Eng., 1–10.10.1155/2021/6677314 ↗
24. Deep learning and its role in COVID-19 medical imaging10.1016/j.ibmed.2020.100013 ↗
25. Choquet fuzzy integral-based classifier ensemble technique for COVID-19 detection10.1016/j.compbiomed.2021.104585 ↗
26. Harris Hawks optimisation with Simulated Annealing as a deep feature selection method for screening of COVID-19 CT-scans10.1016/j.asoc.2021.107698 ↗
27. Kundu, R., Basak, H., Singh, P.K., Ahmadian, A., Ferrara, M., and Sarkar, R. (2021). Fuzzy rank-based fusion of CNN models using Gompertz function for screening COVID-19 CT-scans. Sci. Rep., 11.10.1038/s41598-021-93658-y ↗
28. A Survey on Transfer Learning10.1109/TKDE.2009.191 ↗
29. Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
30. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
31. Chollet, F. (2017, January 21–26). Xception: Deep Learning With Depthwise Separable Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
32. Stacked generalization10.1016/S0893-6080(05)80023-1 ↗
33. Hemdan, E.E.D., Shouman, M.A., and Karar, M.E. (2020). COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-ray Images. arXiv.
34. Sethy, P.K., and Behera, S.K. (2020). Detection of Coronavirus Disease (COVID-19) Based on Deep Features. Preprints.10.20944/preprints202003.0300.v1 ↗
35. Support vector machines10.1109/5254.708428 ↗
36. Alqudah, A.M., Qazan, S., Alquran, H.H., Abuqasmieh, I., and Alqudah, A. (2020). Covid-2019 Detection Using X-ray Images and Artificial Intelligence Hybrid Systems. Preprints.10.5455/jjee.204-1585312246 ↗
37. Modified U-Net (mU-Net) With Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Images10.1109/TMI.2019.2948320 ↗
38. Sarker, L., Islam, M., Hannan, T., and Ahmed, Z. (2020). COVID-DenseNet: A Deep Learning Architecture to Detect COVID-19 from Chest Radiology Images. Preprints.10.20944/preprints202005.0151.v1 ↗
39. Yang, X., He, X., Jinyu Zhao, Y.Z., Zhang, S., and Xie, P. (2020). COVID-CT-dataset: A CT scan Dataset about COVID-19. arXiv.
40. Garain, A., Basu, A., Giampaolo, F., Velasquez, J.D., and Sarkar, R. (2021). Detection of COVID-19 from CT scan images: A spiking neural network-based approach. Neural Comput. Appl.10.1007/s00521-021-05910-1 ↗
41. Chattopadhyay, S., Dey, A., Singh, P., Geem, Z., and Sarkar, R. (2021). COVID-19 Detection by Optimizing Deep Residual Features with Improved Clustering-Based Golden Ratio Optimizer. Diagnostics, 11.10.3390/diagnostics11020315 ↗
42. A light CNN for detecting COVID-19 from CT scans of the chest10.1016/j.patrec.2020.10.001 ↗
43. Born, J., Brändle, G., Cossio, M., Disdier, M., Goulet, J., Roulin, J., and Wiedemann, N. (2021). POCOVID-Net: Automatic Detection of COVID-19 From a New Lung Ultrasound Imaging Dataset (POCUS). arXiv.
44. Sen, S., Saha, S., Chatterjee, S., Mirjalili, S., and Sarkar, R. (2021). A bi-stage feature selection approach for COVID-19 prediction using chest CT images. Appl. Intell., 1–16.10.1007/s10489-021-02292-8 ↗
45. Karbhari, Y., Basu, A., Geem, Z.W., Han, G.T., and Sarkar, R. (2021). Generation of Synthetic Chest X-ray Images and Detection of COVID-19: A Deep Learning Based Approach. Diagnostics, 11.10.3390/diagnostics11050895 ↗
46. Bi-Level Prediction Model for Screening COVID-19 Patients Using Chest X-ray Images10.1016/j.bdr.2021.100233 ↗
47. Jaiswal, A., Gianchandani, N., Singh, D., Kumar, V., and Kaur, M. (2020). Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning. J. Biomol. Struct. Dyn., 1–8.10.1080/07391102.2020.1788642 ↗
48. Zheng, C., Deng, X., Fu, Q., feng Zhou, Q., Feng, J., Ma, H., Liu, W., and Wang, X. (2020). Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label. medRxiv.10.1101/2020.03.12.20027185 ↗
49. Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT10.1148/radiol.2020200905 ↗
50. Soares, E., Angelov, P., Biaso, S., Froes, M.H., and Abe, D.K. (2020). SARS-CoV-2 CT-scan dataset: A large dataset of real patients CT scans for SARS-CoV-2 identification. medRxiv.
51. Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases10.1148/radiol.2020200642 ↗
52. Dropout: A Simple Way to Prevent Neural Networks from Overfitting
53. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on International Conference on Machine Learning—Volume 37, ICML’15, Lille, France.
54. Ensemble learning: A survey10.1002/widm.1249 ↗
55. Schwenker, F., Roli, F., and Kittler, J. (2015). Multiple Classifier Systems, Springer International Publishing.10.1007/978-3-319-20248-8 ↗
56. Pedrycz, W., and Chen, S.M. (2018). Multi-classifier-Systems: Architectures, Algorithms and Applications. Computational Intelligence for Pattern Recognition, Springer International Publishing.
57. Kächele, M., Thiam, P., Palm, G., Schwenker, F., and Schels, M. (2015, January 26). Ensemble Methods for Continuous Affect Recognition: Multi-Modality, Temporality, and Challenges. Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge, AVEC ’15, Brisbane, Australia.10.1145/2808196.2811637 ↗
58. Learning of Decision Fusion Mappings for Pattern Recognition
59. Neural Network Ensembles in Reinforcement Learning10.1007/s11063-013-9334-5 ↗
60. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.74 ↗
61. Lovric, M. (2011). Student’s t-Tests. International Encyclopedia of Statistical Science, Springer.10.1007/978-3-642-04898-2 ↗