Visualization and Interpretation of Convolutional Neural Network Predictions in Detecting Pneumonia in Pediatric Chest Radiographs
Source abstract
Abstract
Pneumonia affects 7% of the global population, resulting in 2 million pediatric deaths every year. Chest X-ray (CXR) analysis is routinely performed to diagnose the disease. Computer-aided diagnostic (CADx) tools aim to supplement decision-making. These tools process the handcrafted and/or convolutional neural network (CNN) extracted image features for visual recognition. However, CNNs are perceived as black boxes since their performance lack explanations. This is a serious bottleneck in applications involving medical screening/diagnosis since poorly interpreted model behavior could adversely affect the clinical decision. In this study, we evaluate, visualize, and explain the performance of customized CNNs to detect pneumonia and further differentiate between bacterial and viral types in pediatric CXRs. We present a novel visualization strategy to localize the region of interest (ROI) that is considered relevant for model predictions across all the inputs that belong to an expected class. We statistically validate the models’ performance toward the underlying tasks. We observe that the customized VGG16 model achieves 96.2% and 93.6% accuracy in detecting the disease and distinguishing between bacterial and viral pneumonia respectively. The model outperforms the state-of-the-art in all performance metrics and demonstrates reduced bias and improved generalization.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: COVID-19 diagnosis using AI · AI in cancer detection · Radiomics and Machine Learning in Medical Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Lister Hill National Center for Biomedical Communications, National Library of Medicine, Bethesda, MD 20894, USA
References (30)
Show source-provided references
1. Incidence and severity of childhood pneumonia in the first year of life in a South African birth cohort: The Drakenstein Child Health Study10.1016/S2214-109X(14)70360-2 ↗
2. Mcluckie, A. (2009). Respiratory Disease and Its Management, Springer. [1st ed.].10.1007/978-1-84882-095-1 ↗
3. Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies
4. Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.M. (2017, January 21–26). ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.369 ↗
5. Combination of texture and shape features to detect pulmonary abnormalities in digital chest X-rays10.1007/s11548-015-1242-x ↗
6. Variability in the Interpretation of Chest Radiographs for the Diagnosis of Pneumonia in Children10.1002/jhm.955 ↗
7. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA.
8. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.F. (2009, January 20–25). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
9. Zeiler, M.D., and Fergus, R. (2014, January 6–12). Visualizing and understanding convolutional networks. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.10.1007/978-3-319-10590-1_53 ↗
10. Bar, Y., Diamant, I., Wolf, L., Lieberman, S., Konen, E., and Greenspan, H. (2015, January 16–19). Chest Pathology Detection Using Deep Learning with Non-Medical Training. Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI), Brooklyn, NY, USA.10.1109/ISBI.2015.7163871 ↗
11. Computer-Aided Diagnosis in Chest Radiography for Detection of Childhood Pneumonia10.1016/j.ijmedinf.2007.10.010 ↗
12. Computer-aided diagnosis in chest radiology10.1053/j.sult.2004.02.004 ↗
13. Image processing and computer-aided diagnosis10.1016/S0033-8389(22)00492-4 ↗
14. Computer-aided diagnosis for detection of interstitial opacities on chest radiographs10.2214/ajr.171.6.9843307 ↗
15. Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning10.1016/j.cell.2018.02.010 ↗
16. Rajpurkar, P., Irvin, J., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., Langlotz, C., and Shpanskaya, K. (2018, January 23). CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning. Available online: https://arxiv.org/abs/1711.05225.
17. Guan, Q., Huang, Y., Zhong, Z., Zheng, Z., Zheng, L., and Yang, Y. (2018, June 17). Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification. Available online: https://arxiv.org/abs/1801.09927v1.
18. Lung Segmentation in Chest Radiographs Using Anatomical Atlases with Nonrigid Registration10.1109/TMI.2013.2290491 ↗
19. Candemir, S., Antani, S., Jaeger, S., Browning, R., and Thoma, G. (2015, January 21–26). Lung Boundary Detection in Pediatric Chest X-Rays. Proceedings of the SPIE Medical Imaging, Orlando, FL, USA.10.1117/12.2081060 ↗
20. SIFT Flow: Dense Correspondence across Scenes and Its Applications10.1109/TPAMI.2010.147 ↗
21. Snoek, J., Rippel, O., and Adams, R.P. (2015, January 6–11). Scalable Bayesian Optimization Using Deep Neural Networks. Proceedings of the International Conference on Machine Learning (ICML), Lille, France.
22. (2018, January 14). Deep Learning Using Bayesian Optimization. Available online: https://www.mathworks.com/help/nnet/examples/deep-learning-using-bayesian-optimization.html.
23. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
24. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
25. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference on Learning Representations (ICLR), San Diego, CA, USA.
26. Random Search for Hyper-Parameter Optimization
27. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27–30). Learning Deep Features for Discriminative Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗
28. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the IEEE International Conference of Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.74 ↗
29. Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13–17). “Why Should I Trust You?”: Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), San Francisco, CA, USA.10.1145/2939672.2939778 ↗
30. Radiological imaging in pneumonia: Recent innovations10.1097/MCP.0b013e3280f3bff4 ↗