journal article·2024-07-07Open access

Integrating Shapley Values into Machine Learning Techniques for Enhanced Predictions of Hospital Admissions

Georgios Feretzakis, Aikaterini Sakagianni, Athanasios Anastasiou, Ioanna Kapogianni, Effrosyni Bazakidou, Petros Koufopoulos, Yiannis Koumpouros, Christina Koufopoulou, Vasileios Kaldis, Vassilios S. Verykios

Applied Sciences· Volume 14· Issue 13

Abstract

(1) Background: Predictive modeling is becoming increasingly relevant in healthcare, aiding in clinical decision making and improving patient outcomes. However, many of the most potent predictive models, such as deep learning algorithms, are inherently opaque, and their decisions are challenging to interpret. This study addresses this challenge by employing Shapley Additive Explanations (SHAP) to facilitate model interpretability while maintaining prediction accuracy. (2) Methods: We utilized Gradient Boosting Machines (GBMs) to predict patient outcomes in an emergency department setting, with a focus on model transparency to ensure actionable insights. (3) Results: Our analysis identifies “Acuity”, “Hours”, and “Age” as critical predictive features. We provide a detailed exploration of their intricate interactions and effects on the model’s predictions. The SHAP summary plots highlight that “Acuity” has the highest impact on predictions, followed by “Hours” and “Age”. Dependence plots further reveal that higher acuity levels and longer hours are associated with poorer patient outcomes, while age shows a non-linear relationship with outcomes. Additionally, SHAP interaction values uncover that the interaction between “Acuity” and “Hours” significantly influences predictions. (4) Conclusions: We employed force plots for individual-level interpretation, aligning with the current shift toward personalized medicine. This research highlights the potential of combining machine learning’s predictive power with interpretability, providing a promising route concerning a data-driven, evidence-based healthcare future.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Healthcare Policy and Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Science and Technology, Hellenic Open University, 26335 Patras, Greece

Intensive Care Unit, Sismanogleio General Hospital, 15126 Marousi, Greece

Biomedical Engineering Laboratory, National Technical University of Athens, 15780 Athens, Greece

Medical School, Humanitas University, 20072 Milan, Italy

Internal Medicine Department, Sismanogleio General Hospital, 15126 Marousi, Greece

Digital Innovation in Public Health Research Lab, Department of Public and Community Health, University of West Attica, 11521 Athens, Greece

Anesthesiology Department, Aretaieio Hospital, National and Kapodistrian University of Athens, 11528 Athens, Greece

Emergency Department, Sismanogleio General Hospital, 15126 Marousi, Greece

References (33)

Show source-provided references
1. Emergency department crowding10.1136/emermed-2011-200532 ↗
2. International perspectives on emergency department crowding10.1111/j.1553-2712.2011.01235.x ↗
3. Effect of emergency department crowding on outcomes of admitted patients10.1016/j.annemergmed.2012.10.026 ↗
4. Facing COVID-19 in Italy—Ethics, Logistics, and Therapeutics on the Epidemic’s Front Line10.1056/NEJMp2005492 ↗
5. Analysis of sampling techniques for imbalanced data: An n = 648 ADNI study10.1016/j.neuroimage.2013.10.005 ↗
6. A brief survey on big data: Technologies, terminologies and data-intensive applications10.1186/s40537-022-00659-3 ↗
7. Big data: Survey, technologies, opportunities, and challenges10.1155/2014/712826 ↗
8. Randall, S.M., Ferrante, A.M., Boyd, J.H., and Semmens, J.B. (2013). The effect of data cleaning on record linkage quality. BMC Med. Inform. Decis. Mak., 13.10.1186/1472-6947-13-64 ↗
9. Secure Record Linkage of Large Health Data Sets: Evaluation of a Hybrid Cloud Model10.2196/18920 ↗
10. A fast privacy-preserving patient record linkage of time series data10.1038/s41598-023-29132-8 ↗
11. Karapiperis, D., Gkoulalas-Divanis, A., and Verykios, V.S. (2016, January 12–15). LSHDB: A parallel and distributed engine for record linkage and similarity search. Proceedings of the IEEE 16th International Conference on Data Mining Workshops (ICDMW), Barcelona, Spain.10.1109/ICDMW.2016.7867099 ↗
12. AI-Driven Malaria Diagnosis: Developing a Robust Model for Accurate Detection and Classification of Malaria Parasites10.61186/ijbc.15.3.112 ↗
13. A survey of methods for explaining black box models10.1145/3236009 ↗
14. A unified approach to interpreting model predictions
15. MIMIC-IV (version 2.2)10.1038/s41597-022-01899-x ↗
16. PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals10.1161/01.CIR.101.23.e215 ↗
17. A value for n-person games
18. Huang, T., Le, D., Yuan, L., Xu, S., and Peng, X. (2023). Machine learning for prediction of in-hospital mortality in lung cancer patients admitted to intensive care unit. PLoS ONE, 18.10.1371/journal.pone.0280606 ↗
19. Learning from longitudinal data in electronic health record and genetic data to improve cardiovascular event prediction10.1038/s41598-018-36745-x ↗
20. Benchmarking emergency department prediction models with machine learning and public electronic health records10.1038/s41597-022-01782-9 ↗
21. Using emergency department triage for machine learning-based admission and mortality prediction10.1097/MEJ.0000000000001068 ↗
22. Using Google Flu Trends data in forecasting influenza-like-illness related ED visits in Omaha, Nebraska10.1016/j.ajem.2014.05.052 ↗
23. Machine learning-based prediction of clinical outcomes for children during emergency department triage10.1001/jamanetworkopen.2018.6937 ↗
24. Prediction of Hospitalization Using Machine Learning for Emergency Department Patients
25. Exploratory Clustering for Emergency Department Patients
26. Predicting Hospital Admission for Emergency Department Patients: A Machine Learning Approach
27. Predicting acute clinical deterioration with interpretable machine learning to support emergency care decision making10.1038/s41598-023-40661-0 ↗
28. Nohara, Y., Matsumoto, K., Soejima, H., and Nakashima, N. (2022). Explanation of machine learning models using shapley additive explanation and application for real data in hospital. Comput. Methods Programs Biomed., 214.10.1016/j.cmpb.2021.106584 ↗
29. Greedy Function Approximation: A Gradient Boosting Machine10.1214/aos/1013203451 ↗
30. The association between length of emergency department boarding and mortality10.1111/j.1553-2712.2011.01236.x ↗
31. The elderly in the emergency department: A critical review of problems and solutions10.1007/s11739-007-0081-3 ↗
32. National Research Council (US) Committee on A Framework for Developing a New Taxonomy of Disease (2024, April 21). Toward Precision Medicine: Building a Knowledge Network for Biomedical Research and a New Taxonomy of Disease, Available online: https://www.ncbi.nlm.nih.gov/books/NBK91503/.
33. Prognosis and prognostic research: What, why, and how?10.1136/bmj.b375 ↗