Enhancing an Imbalanced Lung Disease X-ray Image Classification with the CNN-LSTM Model
Source abstract
Abstract
Lung diseases have a significant impact on respiratory health, causing various symptoms and posing challenges in diagnosis and treatment. This research presents a methodology for classifying lung diseases using chest X-ray images, specifically focusing on COVID-19, pneumonia, and normal cases. The study introduces an optimal architecture for convolutional neural network (CNN) and long short-term memory (LSTM) models, considering evaluation metrics and training efficiency. Furthermore, the issue of imbalanced datasets is addressed through the application of some image augmentation techniques to enhance model performance. The most effective model comprises five convolutional blocks, two LSTM layers, and no augmentation, achieving an impressive F1 score of 0.9887 with a training duration of 91 s per epoch. Misclassifications primarily occurred in normal cases, accounting for only 3.05% of COVID-19 data. The pneumonia class demonstrated excellent precision, while the normal class exhibited high recall and an F1 score. Comparatively, the CNN-LSTM model outperformed the CNN model in accurately classifying chest X-ray images and identifying infected lungs. This research provides valuable insights for improving lung disease diagnosis, enabling timely and accurate identification of lung diseases, and ultimately enhancing patients’ outcomes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: COVID-19 diagnosis using AI · Phonocardiography and Auscultation Techniques · Lung Cancer Diagnosis and Treatment
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Statistics, Faculty of Mathematics and Natural Sciences, Universitas Padjadjaran, Bandung 45363, Indonesia
Department of Computer Science, Faculty of Mathematics and Natural Sciences, Universitas Padjadjaran, Bandung 45363, Indonesia
Department of Public Health, Faculty of Medicine, Universitas Padjadjaran, Bandung 45363, Indonesia
Funding
Directorate for Research and Community Service (DRPM) Universitas Padjadjaran
References (51)
Show source-provided references
1. Interstitial Lung Disease10.1183/09059180.00009113 ↗
2. Diagnosing and Treating Lung Disease at the Cellular Level10.1152/ajplung.00372.2020 ↗
3. A Systematic Review of Neurological Symptoms and Complications of COVID-1910.1007/s00415-020-10067-3 ↗
4. Community-Acquired Pneumonia in Children10.1056/NEJMra011994 ↗
5. Detection and Classification of Lung Diseases for Pneumonia and COVID-19 Using Machine and Deep Learning Techniques10.1007/s12652-021-03464-7 ↗
6. COVID-19 Pneumonia: Different Respiratory Treatments for Different Phenotypes?10.1007/s00134-020-06033-2 ↗
7. Automatic Detection of Coronavirus Disease (COVID-19) Using X-ray Images and Deep Convolutional Neural Networks10.1007/s10044-021-00984-y ↗
8. An Efficient CNN Model for COVID-19 Disease Detection Based on X-ray Image Classification10.1155/2021/6621607 ↗
9. COVID-19 Detection Using Artificial Intelligence
10. Coronavirus (COVID-19) Detection from Chest Radiology Images Using Convolutional Neural Networks10.1016/j.bspc.2021.102490 ↗
11. A Novel Approach for Prediction of Lung Disease Using Chest X-ray Images Based on DenseNet and MobileNet
12. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
13. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2016). Densely Connected Convolutional Networks. arXiv.10.1109/CVPR.2017.243 ↗
14. Application of Convolutional Neural Networks for COVID-19 Detection in X-ray Images Using InceptionV3 and U-Net10.1007/s00354-023-00217-2 ↗
15. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2015). Rethinking the Inception Architecture for Computer Vision. arXiv.10.1109/CVPR.2016.308 ↗
16. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.10.1007/978-3-319-24574-4_28 ↗
17. Badrahadipura, R., Nur Septi, S.Q., Fachrel, J., Yulita, I.N., Pravitasari, A.A., and Agustian, D. (2021, January 27–29). COVID-19 Detection in Chest X-rays Using Inception Resnet-V2. Proceedings of the 2021 International Conference on Artificial Intelligence and Big Data Analytics, ICAIBDA 2021, Bandung, Indonesia.10.1109/ICAIBDA53487.2021.9689723 ↗
18. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Proceedings of the 31st AAAI Conference on Artificial Intelligence, AAAI 2017, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
19. Classification of COVID-19 in Chest X-ray Images Using DeTraC Deep Convolutional Neural Network10.1007/s10489-020-01829-7 ↗
20. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings, San Diego, CA, USA.
21. Priddy, K.L., and Paul, E. (2005). Keller. Artificial Neural Networks: An Introduction, SPIE Press.10.1117/3.633187 ↗
22. Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992, January 27–29). Training Algorithm for Optimal Margin Classifiers. Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, Pittsburgh, PA, USA.10.1145/130385.130401 ↗
23. Nearest Neighbor Pattern Classification10.1109/TIT.1967.1053964 ↗
24. Rahman, A., and Tasnim, S. (2014). Ensemble Classifiers and Their Applications: A Review. arXiv Prepr.10.14445/22312803/IJCTT-V10P107 ↗
25. DeepCoroNet: A Deep LSTM Approach for Automated Detection of COVID-19 Cases from Chest X-ray Images10.1016/j.asoc.2021.107160 ↗
26. An Effective Deep Residual Network Based Class Attention Layer with Bidirectional LSTM for Diagnosis and Classification of COVID-1910.1080/02664763.2020.1849057 ↗
27. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
28. Touvron, H., Cord, M., Sablayrolles, A., Synnaeve, G., and Jégou, H. (2021, January 11–17). Going Deeper with Image Transformers. Proceedings of the IEEE International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00010 ↗
29. Bilateral Filtering: Theory and Applications10.1561/0600000020 ↗
30. COVID-19 Classification Using Chest X-ray Images: A Framework of CNN-LSTM and Improved Max Value Moth Flame Optimization10.3389/fpubh.2022.948205 ↗
31. Tan, M., and Le, Q.V. (2019, January 9–15). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Long Beach, CA, USA.
32. A Comparison between CNN and Combined CNN-LSTM for Chest X-ray Based COVID-19 Detection10.5267/j.dsl.2023.2.004 ↗
33. Can AI Help in Screening Viral and COVID-19 Pneumonia?10.1109/ACCESS.2020.3010287 ↗
34. Exploring the Effect of Image Enhancement Techniques on COVID-19 Detection Using Chest X-ray Images10.1016/j.compbiomed.2021.104319 ↗
35. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
36. Guo, T., Dong, J., Li, H., and Gao, Y. (2017, January 10–12). Simple Convolutional Neural Network on Image Classification. Proceedings of the 2017 IEEE 2nd International Conference on Big Data Analysis, ICBDA 2017, Beijing, China.10.1109/ICBDA.2017.8078730 ↗
37. Convolutional Neural Networks: An Overview and Application in Radiology10.1007/s13244-018-0639-9 ↗
38. Introduction to Convolutional Neural Network Using Keras; An Understanding from a Statistician
39. Applying FIR and IIR Digital Filters over Video Image Processing
40. Optimizing LSTM for Time Series Prediction in Indian Stock Market10.1016/j.procs.2020.03.257 ↗
41. Forecasting Variation Trends of Stocks via Multiscale Feature Fusion and Long Short-Term Memory Learning
42. Qiu, J., Wang, B., and Zhou, C. (2020). Forecasting Stock Prices with Long-Short Term Memory Neural Network Based on Attention Mechanism. PLoS ONE, 15.10.1371/journal.pone.0227222 ↗
43. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
44. Taroon, G., Tomar, A., Manjunath, C., Balamurugan, M., Ghosh, B., and Krishna, A.V.N. (2020, January 26–27). Employing Deep Learning in Intraday Stock Trading. Proceedings of the 2020 5th International Conference on Research in Computational Intelligence and Communication Networks, ICRCICN 2020, Bangalore, India.10.1109/ICRCICN50933.2020.9296174 ↗
45. Deep Back Propagation–Long Short-Term Memory Network Based Upper-Limb SEMG Signal Classification for Automated Rehabilitation10.1016/j.bbe.2020.05.003 ↗
46. Unsupervised Pre-Training of a Deep LSTM-Based Stacked Autoencoder for Multivariate Time Series Forecasting Problems10.1038/s41598-019-55320-6 ↗
47. Ting, K.M. (2017). Encyclopedia of Machine Learning and Data Mining, Springer.
48. Confusion Matrix-Based Feature Selection
49. Ibrahim, M., Torki, M., and El-Makky, N. (2018, January 17–20). Imbalanced Toxic Comments Classification Using Data Augmentation and Deep Learning. Proceedings of the 17th IEEE International Conference on Machine Learning and Applications, ICMLA 2018, Orlando, FL, USA.10.1109/ICMLA.2018.00141 ↗
50. Refaeilzadeh, P., Tang, L., and Liu, H. (2009). Encyclopedia of Database Systems, Springer.
51. A Survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗