journal article·2021-11-05Open access

A LIME-Based Explainable Machine Learning Model for Predicting the Severity Level of COVID-19 Diagnosed Patients

Freddy Gabbay, Shirly Bar-Lev, Ofer Montano, Noam Hadad

Applied Sciences· Volume 11· Issue 21

Abstract

The fast and seemingly uncontrollable spread of the novel coronavirus disease (COVID-19) poses great challenges to an already overloaded health system worldwide. It thus exemplifies an urgent need for fast and effective triage. Such triage can help in the implementation of the necessary measures to prevent patient deterioration and conserve strained hospital resources. We examine two types of machine learning models, a multilayer perceptron artificial neural networks and decision trees, to predict the severity level of illness for patients diagnosed with COVID-19, based on their medical history and laboratory test results. In addition, we combine the machine learning models with a LIME-based explainable model to provide explainability of the model prediction. Our experimental results indicate that the model can achieve up to 80% prediction accuracy for the dataset we used. Finally, we integrate the explainable machine learning models into a mobile application to enable the usage of the proposed models by medical staff worldwide.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: COVID-19 diagnosis using AI · Machine Learning in Healthcare · Artificial Intelligence in Healthcare and Education

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer and Information Science Department, Ruppin Academic Center, Emek Hefer 4025000, Israel

Dror (Imri) Aloni Center for Health Informatics, Ruppin Academic Center, Emek Hefer 4025000, Israel

Computer Engineering Department, Ruppin Academic Center, Emek Hefer 4025000, Israel

References (40)

Show source-provided references
1. Early risk assessment for COVID-19 patients from emergency department data using machine learning10.1038/s41598-021-83784-y ↗
2. An artificial intelligence system for predicting the deterioration of COVID-19 patients in the emergency department10.1038/s41746-021-00453-0 ↗
3. Viral load dynamics and disease severity in patients infected with SARS-CoV-2 in Zhejiang province, China, January-March 2020: Retrospective cohort study10.1136/bmj.m1443 ↗
4. Aggarwal, C.C. (2019). Neural Networks and Deep Learning: A Textbook, Springer Nature.10.1007/978-3-319-94463-0 ↗
5. Apples-to-apples in cross-validation studies: Pitfalls in classifier performance measurement10.1145/1882471.1882479 ↗
6. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
7. Analyzing the Fine Structure of Distributions10.1371/journal.pone.0238835 ↗
8. Ultsch, A., Hoffman, J., Röhnert, M., Von Bonin, M., Oelschlägel, U., Brendel, C., and Thrun, M.C. (2021). An Explainable AI System for the Diagnosis of High Dimensional Biomedical Data. arXiv.
9. A new class of metrics for learning on real-valued and structured data10.1007/s10618-019-00622-6 ↗
10. Sidey-Gibbons, J.A.M., and Sidey-Gibbons, C.J. (2019). Machine learning in medicine: A practical introduction. BMC Med. Res. Methodol., 19.10.1186/s12874-019-0681-4 ↗
11. Diabetes Prediction Using Ensembling of Different Machine Learning Classifiers10.1109/ACCESS.2020.2989857 ↗
12. A comparative study on liver disease prediction using supervised machine learning algorithms
13. Cruz, J.A., and Wishart, D.S. (2006). Applications of Machine Learning in Cancer Prediction and Prognosis. Cancer Inform., 2.10.1177/117693510600200030 ↗
14. Bertsimas, D., Orfanoudaki, A., and Weiner, R.B. (2019). Personalized Treatment for Coronary Artery Disease Patients: A Machine Learning Approach. arXiv.10.1007/s10729-020-09522-4 ↗
15. Applications of machine learning in drug discovery and development10.1038/s41573-019-0024-5 ↗
16. Implementing machine learning in radiology practice and research10.2214/AJR.16.17224 ↗
17. Song, Y., Zheng, S., Li, L., Zhang, X., Zhang, X., Huang, Z., Chen, J., Wang, R., Zhao, H., and Zha, Y. (2021). Deep learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) with CT images. medRxiv.10.1109/TCBB.2021.3065361 ↗
18. Pinter, G., Felde, I., Mosavi, A., Ghamisi, P., and Gloaguen, R. (2020). COVID-19 pandemic prediction for Hungary; A hybrid machine learning approach. Mathematics, 8.10.20944/preprints202005.0031.v1 ↗
19. Machine learning-based prediction of COVID-19 diagnosis based on symptoms10.1038/s41746-020-00372-6 ↗
20. Random Forests10.1023/A:1010933404324 ↗
21. Mexican Federal Health Secretary, General Director of Epidemiology (2021, October 11). Datos Abiertos. Base De Datos Abiertos Históricos Abr-Dic, Available online: https://www.gob.mx/salud/documentos/datos-abiertos-152127.
22. Lundberg, S., and Lee, S.-I. (2017, January 4–9). A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
23. Punn, N.S., Sonbhadra, S.K., and Agarwal, S. (2020). COVID-19 epidemic analysis using machine learning and deep learning algorithms. bioRxiv.10.1101/2020.04.08.20057679 ↗
24. Application of the ARIMA model on the COVID-2019 epidemic dataset10.1016/j.dib.2020.105340 ↗
25. Deb, S., and Majumdar, M. (2020). A time series method to analyze incidence pattern and estimate reproduction number of COVID-19. arXiv.
26. A machine learning forecasting model for COVID-19 pandemic in India10.1007/s00477-020-01827-8 ↗
27. A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: A study of a family cluster10.1016/S0140-6736(20)30154-9 ↗
28. Preventing COVID-19 from the perspective of industrial information integration: Evaluation and continuous improvement of information networks for sustainable epidemic prevention
29. Coronavirus disease 2019 (COVID-19): A perspective from China10.1148/radiol.2020200490 ↗
30. Wang, L., and Wong, A. (2020). COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images. arXiv.10.1038/s41598-020-76550-z ↗
31. Kumar, V. (2021, October 11). Healthcare Centers are Turning to AI to Combat COVID-19. Analytics Insight, Available online: https://www.analyticsinsight.net/healthcare-centers-turning-ai-combat-covid-19.
32. COVID-19 artificial intelligence diagnosis using only cough recordings10.1109/OJEMB.2020.3026928 ↗
33. Maghdid, H.S., Ghafoor, K.Z., Sadiq, A.S., Curran, K., Rawat, D.B., and Rabie, K. (2020). A novel AI-enabled framework to diagnose Coronavirus COVID 19 using smartphone embedded sensors: Design study. arXiv.10.1109/IRI49571.2020.00033 ↗
34. de Moraes Batista, A.F., Miraglia, J.L., Rizzi Donato, T.H., and Porto Chiavegatto Filho, A.D. (2020). COVID-19 diagnosis prediction in emergency care patients: A machine learning approach. bioRxiv.10.1101/2020.04.04.20052092 ↗
35. Towards an artificial intelligence framework for data-driven prediction of Coronavirus clinical severity
36. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
37. Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13–17). Why should I trust you?: Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939778 ↗
38. Visani, G., Bagli, E., Chesani, F., Poluzzi, A., and Capuzzo, D. (2020). Statistical stability indices for LIME: Obtaining reliable explanations for Machine Learning models. arXiv.10.1080/01605682.2020.1865846 ↗
39. Gad, A.F.M. (2019). Building Android Apps in Python Using Kivy with Android Studio: With Pyjnius, Plyer, and Buildozer, APress. [1st ed.].10.1007/978-1-4842-5031-0 ↗
40. Gulli, A., and Pal, S. (2017). Deep Learning with Keras, Packt Publishing.