journal article·2020-04-23Open access

A Transfer Learning Method for Pneumonia Classification and Visualization

Juan Luján-García, Cornelio Yáñez-Márquez, Yenny Villuendas-Rey, Oscar Camacho-Nieto

Applied Sciences· Volume 10· Issue 8

Abstract

Pneumonia is an infectious disease that affects the lungs and is one of the principal causes of death in children under five years old. The Chest X-ray images technique is one of the most used for diagnosing pneumonia. Several Machine Learning algorithms have been successfully used in order to provide computer-aided diagnosis by automatic classification of medical images. For its remarkable results, the Convolutional Neural Networks (models based on Deep Learning) that are widely used in Computer Vision tasks, such as classification of injuries and brain abnormalities, among others, stand out. In this paper, we present a transfer learning method that automatically classifies between 3883 chest X-ray images characterized as depicting pneumonia and 1349 labeled as normal. The proposed method uses the Xception Network pre-trained weights on ImageNet as an initialization. Our model is competitive with respect to state-of-the-art proposals. To make comparisons with other models, we have used four well-known performance measures, obtaining the following results: precision (0.84), recall (0.99), F1-score (0.91) and area under the ROC curve (0.97). These positive results allow us to consider our proposal as an alternative that can be useful in countries with a lack of equipment and specialized radiologists.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: COVID-19 diagnosis using AI · AI in cancer detection · Digital Imaging for Blood Diseases

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico City 07700, Mexico

Centro de Innovación y Desarrollo Tecnológico en Cómputo, Instituto Politécnico Nacional, Mexico City 07700, Mexico

References (50)

Show source-provided references
1. Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children10.1007/s00247-019-04593-0 ↗
2. Computer-Aided Diagnosis in Medical Imaging: Historical review, current status and future potential10.1016/j.compmedimag.2007.02.002 ↗
3. Suetens, P. (2009). Fundamentals of Medical Imaging, Cambridge University Press. [2nd ed.].10.1017/CBO9780511596803 ↗
4. Aliyu, G., El-Kamary, S.S., Abimiku, A.L., Hungerford, L., Obasanya, J., and Blattner, W. (2014). Cost-effectiveness of point-of-care digital chest-x-ray in HIV patients with pulmonary mycobacterial infections in Nigeria. BMC Infect. Dis., 14.10.1186/s12879-014-0675-0 ↗
5. Sutton, D. (2003). Textbook of Radiology and Imaging, Churchill Livingstone Elsevier. [7th ed.].
6. Medical Image Analysis using Convolutional Neural Networks: A Review10.1007/s10916-018-1088-1 ↗
7. Application of deep transfer learning for automated brain abnormality classification using MR images10.1016/j.cogsys.2018.12.007 ↗
8. Li, Z., Wang, C., Han, M., Xue, Y., Wei, W., Li, L.J., and Fei-Fei, L. (2019). Thoracic Disease Identification and Localization with Limited Supervision. Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics. Advances in Computer Vision and Pattern Recognition, Springer.10.1007/978-3-030-13969-8_7 ↗
9. A deep learning-based approach for mitigating falls from height with computer vision: Convolutional neural network10.1016/j.aei.2018.12.005 ↗
10. Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning10.1109/TMI.2018.2791721 ↗
11. A novel end-to-end brain tumor segmentation method using improved fully convolutional networks10.1016/j.compbiomed.2019.03.014 ↗
12. Dual-force convolutional neural networks for accurate brain tumor segmentation10.1016/j.patcog.2018.11.009 ↗
13. Lung segmentation method with dilated convolution based on VGG-16 network10.1080/24699322.2019.1649071 ↗
14. Human activity classification based on sound recognition and residual convolutional neural network10.1016/j.autcon.2020.103177 ↗
15. Liver disease screening based on densely connected deep neural networks10.1016/j.neunet.2019.11.005 ↗
16. Chollet, F. (2019, November 02). Keras: The Python Deep Learning library. Available online: https://keras.io/.
17. ImageNet Large Scale Visual Recognition Challenge10.1007/s11263-015-0816-y ↗
18. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS’12), Lake Tahoe, NV, USA.
19. Deep learning10.1038/nature14539 ↗
20. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition CVPR 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
21. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition CVPR 2016, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
22. Chollet, F. (2017, January 21–26). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition CVPR 2017, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
23. Bakator, M., and Radosav, D. (2018). Deep Learning and Medical Diagnosis: A Review of Literature. Multimodal Technol. Interact., 2.10.3390/mti2030047 ↗
24. Tsiakmaki, M., Kostopoulos, G., Kotsiantis, S., and Ragos, O. (2020). Transfer Learning from Deep Neural Networks for Predicting Student Performance. Appl. Sci., 10.10.3390/app10062145 ↗
25. Chollet, F. (2018). Deep Learning with Python, Manning Publications Co.. [1st ed.].
26. Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.M. (2017, January 21–26). ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition CVPR 2017, Honolulu, HI, USA.10.1109/CVPR.2017.369 ↗
27. Rajpurkar, P., Irvin, J., Ball, R.L., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., and Langlotz, C.P. (2018). Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med., 15.10.1371/journal.pmed.1002686 ↗
28. Blumenfeld, A., Greenspan, H., and Konen, E. (2018, January 27). Pneumothorax detection in chest radiographs using convolutional neural networks. Proceedings of the Medical Imaging 2018: Computer-Aided Diagnosis, Houston, TX, USA.10.1117/12.2292540 ↗
29. Que, Q., Tang, Z., Wang, R., Zeng, Z., Wang, J., Chua, M., Gee, T.S., Yang, X., and Veeravalli, B. (2018, January 17–22). CardioXNet: Automated Detection for Cardiomegaly Based on Deep Learning. Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.10.1109/EMBC.2018.8512374 ↗
30. Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., and Shpanskaya, K. (February, January January). CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
31. A Novel Approach for Multi-Label Chest X-Ray Classification of Common Thorax Diseases10.1109/ACCESS.2019.2916849 ↗
32. Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification10.1038/s41598-019-42294-8 ↗
33. Deep learning: Definition and perspectives for thoracic imaging10.1007/s00330-019-06564-3 ↗
34. An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare10.1155/2019/4180949 ↗
35. Preparing medical imaging data for machine learning10.1148/radiol.2020192224 ↗
36. Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning10.1016/j.cell.2018.02.010 ↗
37. A transfer learning method with deep residual network for pediatric pneumonia diagnosis10.1016/j.cmpb.2019.06.023 ↗
38. Chouhan, V., Singh, S.K., Khamparia, A., Gupta, D., Tiwari, P., Moreira, C., Damaševičius, R., and de Albuquerque, V.H.C. (2020). A novel transfer learning based approach for pneumonia detection in chest X-ray images. Appl. Sci., 10.10.3390/app10020559 ↗
39. Efficient Deep Network Architectures for Fast Chest X-Ray Tuberculosis Screening and Visualization10.1038/s41598-019-42557-4 ↗
40. Feature Selection for Automatic Tuberculosis Screening in Frontal Chest Radiographs10.1007/s10916-018-0991-9 ↗
41. Tourassi, G.D., and Armato, S.G. (March, January 28). A novel approach for tuberculosis screening based on deep convolutional neural networks. Proceedings of the Medical Imaging 2016: Computer-Aided Diagnosis, San Diego, CA, USA.
42. Chauhan, A., Chauhan, D., and Rout, C. (2014). Role of gist and PHOG features in computer-aided diagnosis of tuberculosis without segmentation. PLoS ONE, 9.10.1371/journal.pone.0112980 ↗
43. Kermany, D., Zhang, K., and Goldbaum, M. (2019, October 07). Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification. Available online: https://data.mendeley.com/datasets/rscbjbr9sj/2.
44. An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics10.1016/j.ins.2013.07.007 ↗
45. Szegedy, C., Wei, L., Yangqing, J., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition CVPR 2015, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
46. A systematic analysis of performance measures for classification tasks10.1016/j.ipm.2009.03.002 ↗
47. A study of the behavior of several methods for balancing machine learning training data10.1145/1007730.1007735 ↗
48. Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. Open problems on intrinsic data characteristics10.1016/j.eswa.2011.12.043 ↗
49. (2019, November 02). OpenCV. Available online: https://opencv.org/.
50. Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization10.1007/s11263-019-01228-7 ↗