Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection Using Chest X-ray
Source abstract
Abstract
Pneumonia is a life-threatening disease, which occurs in the lungs caused by either bacterial or viral infection. It can be life-endangering if not acted upon at the right time and thus the early diagnosis of pneumonia is vital. The paper aims to automatically detect bacterial and viral pneumonia using digital x-ray images. It provides a detailed report on advances in accurate detection of pneumonia and then presents the methodology adopted by the authors. Four different pre-trained deep Convolutional Neural Network (CNN): AlexNet, ResNet18, DenseNet201, and SqueezeNet were used for transfer learning. A total of 5247 chest X-ray images consisting of bacterial, viral, and normal chest x-rays images were preprocessed and trained for the transfer learning-based classification task. In this study, the authors have reported three schemes of classifications: normal vs. pneumonia, bacterial vs. viral pneumonia, and normal, bacterial, and viral pneumonia. The classification accuracy of normal and pneumonia images, bacterial and viral pneumonia images, and normal, bacterial, and viral pneumonia were 98%, 95%, and 93.3%, respectively. This is the highest accuracy, in any scheme, of the accuracies reported in the literature. Therefore, the proposed study can be useful in more quickly diagnosing pneumonia by the radiologist and can help in the fast airport screening of pneumonia patients.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: COVID-19 diagnosis using AI · Radiomics and Machine Learning in Medical Imaging · Phonocardiography and Auscultation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Biomedical Physics & Technology, University of Dhaka, Dhaka 1000, Bangladesh
Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
Department of Orthodontics, Bangabandhu Sheikh Mujib Medical University, Dhaka 1000, Bangladesh
Department of Mathematics and Physics, North South University, Dhaka 1229, Bangladesh
Faculty of Robotics and Advanced Computing, Qatar Armed Forces-Academic Bridge Program, Qatar Foundation, Doha 24404, Qatar
Funding
Qatar National Research Fund
References (54)
Show source-provided references
1. Imran, A. (2019, December 23). Training a CNN to detect Pneumonia. Available online: https://medium.com/datadriveninvestor/training-a-cnn-to-detect-pneumonia-c42a44101deb.
2. Mortality prediction in community-acquired pneumonia requiring mechanical ventilation; values of pneumonia and intensive care unit severity scores
3. WHO (2001). Standardization of Interpretation of Chest Radiographs for the Diagnosis of Pneumonia in Children, World Health Organization.
4. Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children10.1002/jhm.955 ↗
5. Reliability of the chest radiograph in the diagnosis of lower respiratory infections in young children. Pediatr10.1097/00006454-199607000-00008 ↗
6. Inter-observer variation in the interpretation of chest radiographs for pneumonia in community-acquired lower respiratory tract infections10.1016/j.crad.2004.01.011 ↗
7. Tahir, A.M., Chowdhury, M.E.H., Khandakar, A., Al-Hamouz, S., Abdalla, M., Awadallah, S., Reaz, M.B.I., and Al-Emadi, N. (2020). A Systematic Approach to the Design and Characterization of a Smart Insole for Detecting Vertical Ground Reaction Force (vGRF) in Gait Analysis. Sensors, 20.10.3390/s20040957 ↗
8. Chowdhury, M.E.H., Alzoubi, K., Khandakar, A., Khallifa, R., Abouhasera, R., Koubaa, S., Ahmed, R., and Hasan, A. (2019). Wearable Real-Time Heart Attack Detection and Warning System to Reduce Road Accidents. Sensors, 19.10.3390/s19122780 ↗
9. Chowdhury, M.E.H., Khandakar, A., Alzoubi, K., Mansoor, S., Tahir, A.M., Reaz, M.B.I., and Al-Emadi, N. (2019). Real-Time Smart-Digital Stethoscope System for Heart Diseases Monitoring. Sensors, 19.10.3390/s19122781 ↗
10. How far have we come? Artificial intelligence for chest radiograph interpretation10.1016/j.crad.2018.12.015 ↗
11. Pdf ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
12. Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.M. (2017, January 21–26). ChestX-ray8: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.369 ↗
13. U-Net: Convolutional Networks for Biomedical Image Segmentation10.1007/978-3-319-24574-4_28 ↗
14. Small lung nodules detection based on local variance analysis and probabilistic neural network10.1016/j.cmpb.2018.04.025 ↗
15. Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs10.1016/j.compbiomed.2018.10.011 ↗
16. Ho, T.K.K., and Gwak, J. (2019). Multiple Feature Integration for Classification of Thoracic Disease in Chest Radiography. Appl. Sci., 9.10.3390/app9194130 ↗
17. Identifying pneumonia in chest X-rays: A deep learning approach10.1016/j.measurement.2019.05.076 ↗
18. A transfer learning method with deep residual network for pediatric pneumonia diagnosis10.1016/j.cmpb.2019.06.023 ↗
19. An automatic method for lung segmentation and reconstruction in chest X-ray using deep neural networks10.1016/j.cmpb.2019.06.005 ↗
20. Taylor, A.G., Mielke, C., and Mongan, J. (2018). Automated detection of moderate and large pneumothorax on frontal chest X-rays using deep convolutional neural networks: A retrospective study. PLoS Med., 15.10.1371/journal.pmed.1002697 ↗
21. CXNet-m1: Anomaly Detection on Chest X-rays With Image-Based Deep Learning10.1109/ACCESS.2018.2885997 ↗
22. Toğaçar, M., Ergen, B., Cömert, Z., and Özyurt, F. (2019). A Deep Feature Learning Model for Pneumonia Detection Applying a Combination of mRMR Feature Selection and Machine Learning Models. IRBM.10.1016/j.irbm.2019.10.006 ↗
23. Saraiva, A., Santos, D., Costa, N., Sousa, J., Ferreira, N., Valente, A., and Soares, S. (2019, January 22–24). Models of Learning to Classify X-ray Images for the Detection of Pneumonia using Neural Networks. Proceedings of the 12th International Joint Conference on Biomedical Engineering Systems and Technologies, Prague, Czech.10.5220/0007346600760083 ↗
24. Ayan, E., and Unver, H.M. (2019, January 24–26). Diagnosis of Pneumonia from Chest X-ray Images Using Deep Learning. Proceedings of the 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), Istanbul, Turkey.10.1109/EBBT.2019.8741582 ↗
25. Khatri, A., Jain, R., Vashista, H., Mittal, N., Ranjan, P., and Janardhanan, R. (2020). Pneumonia Identification in Chest X-ray Images Using EMD. Internet of Things—Applications and Future, Springer Science and Business Media LLC.10.1007/978-981-15-1624-5_9 ↗
26. Differentiation of bacterial and viral pneumonia in children10.1136/thorax.57.5.438 ↗
27. Viral Pneumonia Requiring Differentiation from Acute and Progressive Diffuse Interstitial Lung Diseases10.2169/internalmedicine.2696-19 ↗
28. Chouhan, V., Singh, S.K., Khamparia, A., Gupta, N., Tiwari, P., Moreira, C., Damasevicius, R., and De Albuquerque, V.H.C. (2020). A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray Images. Appl. Sci., 10.10.3390/app10020559 ↗
29. Rajaraman, S., Candemir, S., Kim, I., Thoma, G.R., and Antani, S. (2018). Visualization and Interpretation of Convolutional Neural Network Predictions in Detecting Pneumonia in Pediatric Chest Radiographs. Appl. Sci., 8.10.3390/app8101715 ↗
30. Gu, X., Pan, L., Liang, H., and Yang, R. (2018, January 16–18). Classification of Bacterial and Viral Childhood Pneumonia Using Deep Learning in Chest Radiography. Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia—MUM ’04; Association for Computing Machinery (ACM), Guiyang China.10.1145/3195588.3195597 ↗
31. Gershgorn, D. (2019, December 23). The Data that Transformed AI Research—and Possibly the World. Available online: https://qz.com/1034972/the-data-that-changed-the-direction-of-ai-research-and-possibly-the-world/.
32. Rajpurkar, P., Irvin, J., Ball, R.L., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., and Langlotz, C.P. (2018). Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med., 15.10.1371/journal.pmed.1002686 ↗
33. Jung, H., Kim, B., Lee, I., Lee, J., and Kang, J. (2018). Classification of lung nodules in CT scans using three-dimensional deep convolutional neural networks with a checkpoint ensemble method. BMC Med. Imag., 18.10.1186/s12880-018-0286-0 ↗
34. Deep neural network ensemble for pneumonia localization from a large-scale chest x-ray database10.1016/j.compeleceng.2019.08.004 ↗
35. Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks10.1148/radiol.2017162326 ↗
36. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
37. Albawi, S., Mohammed, T.A., and Al-Azawi, S. (2017, January 21–23). Understanding of a convolutional neural network. Proceedings of the 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey.10.1109/ICEngTechnol.2017.8308186 ↗
38. Goyal, M., Goyal, R., and Lall, B. (2019). Learning Activation Functions: A new paradigm of understanding Neural Networks. arXiv.10.1007/978-3-030-31760-7_1 ↗
39. Bailer, C., Habtegebrial, T., Varanasi, K., and Stricker, D. (2018). Fast Feature Extraction with CNNs with Pooling Layers. arXiv.
40. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
41. Alcoholism Identification Based on an AlexNet Transfer Learning Model
42. Multisource Transfer Learning With Convolutional Neural Networks for Lung Pattern Analysis10.1109/JBHI.2016.2636929 ↗
43. Transfer-Learning-Based Online Mura Defect Classification10.1109/TSM.2017.2777499 ↗
44. Akcay, S., Kundegorski, M.E., Devereux, M., and Breckon, T.P. (2016, January 25–28). Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7532519 ↗
45. Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?10.1109/TMI.2016.2535302 ↗
46. A Survey on Transfer Learning10.1109/TKDE.2009.191 ↗
47. (2019, December 23). ResNet, AlexNet, VGGNet, Inception: Understanding various architectures of Convolutional Networks. Available online: https://cv-tricks.com/cnn/understand-resnet-alexnet-vgg-inception/.
48. LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional networks and applications in vision. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.10.1109/ISCAS.2010.5537907 ↗
49. LeCun, Y., Boser, B.E., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W.E., and Jackel, L.D. (1990). Handwritten digit recognition with a back-propagation network. Advances in Neural Information Processing Systems, The MIT Press.
50. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
51. (2019, December 23). DenseNet: Better CNN Model than ResNet. Available online: http://www.programmersought.com/article/7780717554/.
52. Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size. arXiv.
53. Mooney, P. (2019, December 23). Chest X-ray Images (Pneumonia). Available online: https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia.
54. Cohen, J.P., Bertin, P., and Frappier, V. (2019). Chester: A Web Delivered Locally Computed Chest X-ray Disease Prediction System. arXiv.