journal article·2025-02-06Open access

Machine Learning-Based Model for Emergency Department Disposition at a Public Hospital

Savaş Sezik, Mustafa Özgür Cingiz, Esma İbiş

Applied Sciences· Volume 15· Issue 3

Abstract

With the increasing global demand for artificial intelligence solutions, their role in medicine is also expected to grow as a result of their advantage of easy access to clinical data. Machine learning models, with their ability to process large amounts of data, can help solve clinical issues. The aim of this study was to construct seven machine learning models to predict the outcomes of emergency department patients and compare their prediction performance. Data from 75,803 visits to the emergency department of a public hospital between January 2022 to December 2023 were retrospectively collected. The final dataset incorporated 34 predictors, including two sociodemographic factors, 23 laboratory variables, five initial vital signs, and four emergency department-related variables. They were used to predict the outcomes (mortality, referral, discharge, and hospitalization). During the study period, 316 (0.4%) visits ended in mortality, 5285 (7%) in referral, 13,317 (17%) in hospitalization, and 56,885 (75%) in discharge. The disposition accuracy (sensitivity and specificity) was evaluated using 34 variables for seven machine learning tools according to the area under the curve (AUC). The AUC scores were 0.768, 0.694, 0.829, 0.879, 0.892, 0.923, and 0.958 for Adaboost, logistic regression, K-nearest neighbor, LightGBM, CatBoost, XGBoost, and Random Forest (RF) models, respectively. The machine learning models, especially the discrimination ability of the RF model, were much more reliable in predicting the clinical outcomes in the emergency department. XGBoost and CatBoost ranked second and third, respectively, following RF modeling.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Emergency and Acute Care Studies · Machine Learning in Healthcare · Healthcare Operations and Scheduling Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Division of Emergency Medicine, Odemiş State Hospital, 35750 Izmir, Türkiye

Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Bursa Technical University, 16310 Bursa, Türkiye

References (35)

Show source-provided references
1. National Center for Health Statistics (US) (2013). Health, United States, 2012: With Special Feature on Emergency Care, National Center for Health Statistics (US). Report No.: 2013-1232.
2. Morley, C., Unwin, M., Peterson, G.M., Stankovich, J., and Kinsman, L. (2018). Emergency department crowding: A systematic review of causes, consequences and solutions. PLoS ONE, 13.10.1371/journal.pone.0203316 ↗
3. Effect of emergency department crowding on outcomes of admitted patients10.1016/j.annemergmed.2012.10.026 ↗
4. The ED as the primary source of hospital admission for older (but not younger) adults10.1016/j.ajem.2015.05.041 ↗
5. Applications of Machine Learning Approaches in Emergency Medi-cine; a Review Article
6. Improving emergency department efficiency by patient streaming to outcomes-based teams10.1071/AH070016 ↗
7. Redesigning emergency department patient flows: Application of Lean Thinking to health care10.1111/j.1742-6723.2006.00872.x ↗
8. Locally Informed Simulation to Predict Hospital Capacity Needs During the COVID-19 Pandemic10.7326/M20-1260 ↗
9. The AI Future of Emergency Medicine10.1016/j.annemergmed.2024.01.031 ↗
10. Health intelligence: How artificial intelligence transforms population and personalized health10.1038/s41746-018-0058-9 ↗
11. Benchmarking emergency department prediction models with machine learning and public electronic health records10.1038/s41597-022-01782-9 ↗
12. Feretzakis, G., Sakagianni, A., Loupelis, E., Karlis, G., Kalles, D., Tzelves, L., Chatzikyriakou, R., Trakas, N., Petropoulou, S., and Tika, A. (2022). Predicting Hospital Admission for Emergency Department Patients: A Machine Learning Approach. Informatics and Technology in Clinical Care and Public Health, IOS Press. Studies in Health Technology and Informatics Volume 289.10.3233/SHTI210918 ↗
13. Larburu, N., Azkue, L., and Kerexeta, J. (2023). Predicting Hospital Ward Admission from the Emergency Department: A Systematic Review. J. Pers. Med., 13.10.3390/jpm13050849 ↗
14. Using Machine Learning Techniques to Predict Hospital Admission at the Emergency Department10.2478/jccm-2022-0003 ↗
15. Early prediction of hospital admission of emergency department patients10.1111/1742-6723.14169 ↗
16. Predicting hospital admission at the emergency department triage: A novel prediction model10.1016/j.ajem.2018.10.060 ↗
17. Machine learning for developing a prediction model of hospital admission of emergency department patients: Hype or hope?10.1016/j.ijmedinf.2021.104496 ↗
18. Hong, W.S., Haimovich, A.D., and Taylor, R.A. (2018). Predicting hospital admission at emergency department triage using machine learning. PLoS ONE, 13.10.1371/journal.pone.0201016 ↗
19. Using Data Mining to Predict Hospital Admissions From the Emergency Department10.1109/ACCESS.2018.2808843 ↗
20. Using Machine Learning Techniques to Support the Emergency Department10.31577/cai_2022_1_154 ↗
21. Cusidó, J., Comalrena, J., Alavi, H., and Llunas, L. (2022). Predicting hospital admissions to reduce crowding in the emergency departments. Appl. Sci., 12.10.3390/app122110764 ↗
22. Ministry of Health of the Republic of Turkey (2022, September 13). Yataklı Sağlık Tesislerinde Acil Servis Hizmetlerinin Uygulama Usul Ve Esasları Hakkında Tebliğ, Available online: https://www.saglik.gov.tr/TR,11321/yatakli-saglik-tesislerinde-acil-servis-hizmetlerinin-uygulama-usul-ve-esaslari-hakkinda-teblig.html.
23. Machine learning for E-triage
24. Comparative analysis of image classification algorithms based on traditional machine learning and deep learning10.1016/j.patrec.2020.07.042 ↗
25. Operating machine learning across natural language processing techniques for improvement of fabricated news model
26. Ogunpola, A., Saeed, F., Basurra, S., Albarrak, A.M., and Qasem, S.N. (2024). Machine learning-based predictive models for detection of cardiovascular diseases. Diagnostics, 14.10.3390/diagnostics14020144 ↗
27. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis10.1038/s41591-022-01894-0 ↗
28. Scikit-learn: Machine learning in Python
29. Application of kNN and SVM to predict the prognosis of advanced sChistosomiasis10.1007/s00436-022-07583-8 ↗
30. Ho, J.C., Sotoodeh, M., Zhang, W., Simpson, R.L., and Hertzberg, V.S. (2024). An AdaBoost-based algorithm to detect hospital-acquired pressure injury in the presence of conflicting annotations. Comput. Biol. Med., 168.10.1016/j.compbiomed.2023.107754 ↗
31. A comparative study of supervised machine learning approaches to predict patient triage outcomes in hospital emergency departments10.1016/j.array.2023.100281 ↗
32. Machine learning-based models to support decision-making in emergency department triage for patients with suspected cardiovascular disease10.1016/j.ijmedinf.2020.104326 ↗
33. Machine learning based early mortality prediction in the emergency department10.1016/j.ijmedinf.2021.104570 ↗
34. Chang, Y.H., Shih, H.M., Wu, J.E., Huang, F.W., Chen, W.K., Chen, D.M., Chung, Y.T., and Wang, C.C. (2022). Machine learning–based triage to identify low-severity patients with a short discharge length of stay in emergency department. BMC Emerg. Med., 22.10.1186/s12873-022-00632-6 ↗
35. Logistic regression in clinical studies10.1016/j.ijrobp.2021.08.007 ↗