journal article·2022-12-24Open access

Severity Prediction of Highway Crashes in Saudi Arabia Using Machine Learning Techniques

Ibrahim Aldhari, Meshal Almoshaogeh, Arshad Jamal, Fawaz Alharbi, Majed Alinizzi, Husnain Haider

Applied Sciences· Volume 13· Issue 1

Abstract

Kingdom of Among the G20 countries, Saudi Arabia (KSA) is facing alarming traffic safety issues compared to other G-20 countries. Mitigating the burden of traffic accidents has been identified as a primary focus as part of vision 20230 goals. Driver distraction is the primary cause of increased severity traffic accidents in KSA. In this study, three different machine learning-based severity prediction models were developed and implemented for accident data from the Qassim Province, KSA. Traffic accident data for January 2017 to December 2019 assessment period were obtained from the Ministry of Transport and Logistics Services. Three classifiers, two of which are ensemble machine learning methods, namely random forest, XGBoost, and logistic regression, were used for crash injury severity classification. A resampling technique was used to deal with the problem of bias due to data imbalance issue. SHapley Additive exPlanations (SHAP) analysis interpreted and ranked the factors contributing to crash injury. Two forms of modeling were adopted: multi and binary classification. Among the three models, XGBoost achieved the highest classification accuracy (71%), precision (70%), recall (71%), F1-scores (70%), and area curve (AUC) (0.87) of receiver operating characteristic (ROC) curve when used for multi-category classifications. While adopting the target as a binary classification, XGBoost again outperformed the other classifiers with an accuracy of 94% and an AUC of 0.98. The SHAP results from both global and local interpretations illustrated that the accidents classified under property damage only were primarily categorized by their consequences and the number of vehicles involved. The type of road and lighting conditions were among the other influential factors affecting injury s severity outcome. The death class was classified with respect to temporal parameters, including month and day of the week, as well as road type. Assessing the factors associated with the severe injuries caused by road traffic accidents will assist policymakers in developing safety mitigation strategies in the Qassim Region and other regions of Saudi Arabia.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Traffic and Road Safety · Traffic Prediction and Management Techniques · Injury Epidemiology and Prevention

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Civil Engineering, College of Engineering, Qassim University, Buraydah 51452, Saudi Arabia

Transportation and Traffic Engineering Department, College of Engineering, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam 31451, Saudi Arabia

References (75)

Show source-provided references
1. International Transport Forum (ITF) (2021). Road Safety Annual Report 2021: The Impact of COVID-19, ITF.
2. World Health Organization (WHO) (2018). Global Status Report on Road Safety, WHO.
3. A framework for accident reduction and risk identification and assessment in Saudi Arabia10.1108/WJSTSD-06-2014-0008 ↗
4. Peer reviewed: Burden of disease, injuries, and risk factors in the Kingdom of Saudi Arabia, 1990–201010.5888/pcd11.140176 ↗
5. Epidemiology of road traffic injuries in Qassim region, Saudi Arabia: Consistency of police and health data
6. FHWA (2010). Highway Safety Manual.
7. Investigating factors affecting severity of large truck-involved crashes: Comparison of the SVM and random parameter logit model10.1016/j.jsr.2021.02.012 ↗
8. Exploiting Machine Learning Algorithms for Predicting Crash Injury Severity in Yemen: Hospital Case Study10.11648/j.acm.20200905.12 ↗
9. Injury severity prediction model for two-wheeler crashes at mid-block road sections10.1080/13588265.2020.1806644 ↗
10. Crash injury severity analysis using a two-layer Stacking framework10.1016/j.aap.2018.10.016 ↗
11. Bahiru, T.K., Singh, D.K., and Tessfaw, E.A. (2018, January 20–21). Comparative study on data mining classification algorithms for predicting road traffic accident severity. Proceedings of the 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT), Coimbatore, India.10.1109/ICICCT.2018.8473265 ↗
12. Using data mining techniques to predict the severity of bicycle crashes10.1016/j.aap.2017.01.008 ↗
13. Analysis of injury traffic accidents with machine learning methods: Adana case10.5505/pajes.2016.87847 ↗
14. Mining Pattern from Road Accident Data: Role of Road User’s Behaviour and Implications for improving road safety
15. Zhang, S., Khattak, A., Matara, C.M., Hussain, A., and Farooq, A. (2022). Hybrid feature selection-based machine learning Classification system for the prediction of injury severity in single and multiple-vehicle accidents. PLoS ONE, 17.10.1371/journal.pone.0262941 ↗
16. Predicting crash injury severity at unsignalized intersections using support vector machines and naïve Bayes classifiers10.1093/tse/tdaa012 ↗
17. On Scene Injury Severity Prediction (OSISP) machine learning algorithms for motor vehicle crash occupants in US10.1016/j.jth.2021.101124 ↗
18. Improved support vector machine models for work zone crash injury severity prediction and analysis10.1177/0361198119845899 ↗
19. An analytic framework using deep learning for prediction of traffic accident injury severity based on contributing factors10.1016/j.aap.2021.106322 ↗
20. AlMamlook, R.E., Kwayu, K.M., Alkasisbeh, M.R., and Frefer, A.A. (2019, January 9–11). Comparison of machine learning algorithms for predicting traffic accident severity. Proceedings of the 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT), Amman, Jordan.10.1109/JEEIT.2019.8717393 ↗
21. Chen, M.-M., and Chen, M.-C. (2020). Modeling road accident severity with comparisons of logistic regression, decision tree and random forest. Information, 11.10.3390/info11050270 ↗
22. Niyogisubizo, J., Liao, L., Lin, Y., Luo, L., Nziyumva, E., and Murwanashyaka, E. (2021, January 17–19). A Novel Stacking Framework Based On Hybrid of Gradient Boosting-Adaptive Boosting-Multilayer Perceptron for Crash Injury Severity Prediction and Analysis. Proceedings of the 2021 IEEE 4th International Conference on Electronics and Communication Engineering (ICECE), Xi’an, China.10.1109/ICECE54449.2021.9674567 ↗
23. Risk factors of fatality in motor vehicle traffic accidents10.1016/0001-4575(94)90013-2 ↗
24. Applying the ordered probit model to injury severity in truck-passenger car rear-end collisions10.3141/1635-09 ↗
25. Al-Turaiki, I., Aloumi, M., Aloumi, N., and Alghamdi, K. (2016, January 6–9). Modeling traffic accidents in Saudi Arabia using classification techniques. Proceedings of the 2016 4th Saudi International Conference on Information Technology (Big Data Analysis)(KACSTIT), Riyadh, Saudi Arabia.10.1109/KACSTIT.2016.7756072 ↗
26. Data-mining techniques for traffic accident modeling and prediction in the United Arab Emirates
27. Severity prediction of traffic accident using an artificial neural network10.1002/for.2425 ↗
28. Bagging predictors10.1007/BF00058655 ↗
29. Comparing prediction performance for crash injury severity among various machine learning and statistical methods10.1109/ACCESS.2018.2874979 ↗
30. A perspective analysis of traffic accident using data mining techniques
31. Jiang, H. (2019). A comparative study on machine learning based algorithms for prediction of motorcycle crash severity. PLoS ONE, 14.10.1371/journal.pone.0214966 ↗
32. Machine learning methods to analyze injury severity of drivers from different age and gender groups10.1177/0361198118794292 ↗
33. Prediction and factor identification for crash severity: Comparison of discrete choice and tree-based models10.1177/0361198119844456 ↗
34. A literature review of machine learning algorithms for crash injury severity prediction10.1016/j.jsr.2021.12.007 ↗
35. Load-settlement response of a footing over buried conduit in a sloping terrain: A numerical experiment-based artificial intelligent approach10.1007/s00500-021-06628-x ↗
36. Analyzing injury severity of motorcycle at-fault crashes using machine learning techniques, decision tree and logistic regression models10.1016/j.ijtst.2019.10.002 ↗
37. Mokoatle, M., Vukosi Marivate, D., and Michael Esiefarienrhe Bukohwo, P. (2019, January 18–20). Predicting road traffic accident severity using accident report data in South Africa. Proceedings of the 20th Annual International Conference on Digital Government Research, Dubai, United Arab Emirates.10.1145/3325112.3325211 ↗
38. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
39. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
40. A deep learning based traffic crash severity prediction framework10.1016/j.aap.2021.106090 ↗
41. Stacked generalization10.1016/S0893-6080(05)80023-1 ↗
42. A unified approach to interpreting model predictions
43. Dong, S., Khattak, A., Ullah, I., Zhou, J., and Hussain, A. (2022). Predicting and analyzing road traffic injury severity using boosting-based ensemble learning models with SHAPley Additive exPlanations. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph19052925 ↗
44. Chakraborty, M., Gates, T., and Sinha, S. (2021). Causal Analysis and Classification of Traffic Crash Injury Severity Using Machine Learning Algorithms. arXiv.
45. Modeling highly imbalanced crash severity data by ensemble methods and global sensitivity analysis
46. Labib, M.F., Rifat, A.S., Hossain, M.M., Das, A.K., and Nawrine, F. (2019, January 28–30). Road accident analysis and prediction of accident severity by using machine learning in Bangladesh. Proceedings of the 2019 7th International Conference on Smart Computing & Communications (ICSCC), Sarawak, Malaysia.10.1109/ICSCC.2019.8843640 ↗
47. Injury severity prediction of traffic crashes with ensemble machine learning techniques: A comparative study10.1080/17457300.2021.1928233 ↗
48. Prediction of electric vehicle charging duration time using ensemble machine learning algorithm and Shapley additive explanations10.1002/er.8219 ↗
49. Modeling of machine learning with SHAP approach for electric vehicle charging station choice behavior prediction10.1016/j.tbs.2022.11.006 ↗
50. Transparent deep machine learning framework for predicting traffic crash severity
51. Lin, C., Wu, D., Liu, H., Xia, X., and Bhattarai, N. (2020). Factor identification and prediction for teen driver crash severity using machine learning: A case study. Appl. Sci., 10.10.3390/app10051675 ↗
52. Wu, S., Yuan, Q., Yan, Z., and Xu, Q. (2021). Analyzing accident injury severity via an extreme gradient boosting (XGBoost) model. J. Adv. Transp., 2021.10.1155/2021/3771640 ↗
53. Zhu, S., Wang, K., and Li, C. (2021). Crash injury severity prediction using an ordinal classification machine learning approach. Int. J. Environ. Res. Public Health, 18.10.3390/ijerph182111564 ↗
54. Prediction of California Bearing Ratio of Granular Soil by Multivariate Regression and Gene Expression Programming10.1155/2022/7426962 ↗
55. Minstry of Interior (MOI) (2022, October 08). Emirate of Al-Qasim Province, Available online: https://www.moi.gov.sa/wps/portal/Home/emirates/qasim/.
56. Almoshaogeh, M., Abdulrehman, R., Haider, H., Alharbi, F., Jamal, A., and Alarifi, S. (2021). Traffic accident risk assessment framework for qassim, saudi arabia: Evaluating the impact of speed cameras. Appl. Sci., 11.10.3390/app11156682 ↗
57. Traffic safety factors in the Qassim region of Saudi Arabia
58. Witten, I.H., Frank, E., Trigg, L.E., Hall, M.A., Holmes, G., and Cunningham, S.J. (1999). Weka: Practical Machine Learning Tools and Techniques with Java Implementations, University of Waikato, Department of Computer Science.
59. Witten, I.H., Frank, E., and Hall, M.A. (2005). Data Mining: Practical Machine Learning Tools and Techniques, Elsevier. [3rd ed.].
60. Beshah, T., and Hill, S. (2022, November 17). Mining Road Traffic Accident Data to Improve Safety: Role of Road-Related Factors on Accident Severity in Ethiopia. Available online: https://www.aaai.org/ocs/index.php/SSS/SSS10/paper/view/1173/1343.
61. Prediction and analysis of injury severity in traffic system using data mining techniques
62. Data mining on road safety: Factor assessment on vehicle accidents using classification models10.1080/13588265.2015.1122278 ↗
63. Mitrpanont, J., Sawangphol, W., Vithantirawat, T., Paengkaew, S., Suwannasing, P., Daramas, A., and Chen, Y.C. (2017, January 2–3). A study on using Python vs Weka on dialysis data analysis. Proceedings of the 2017 2nd International Conference on Information Technology (INCIT), Nakhonpathom, Thailand.10.1109/INCIT.2017.8257883 ↗
64. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
65. Xgboost Developers (2022, August 23). Revision 62ed8b5f, Introduction/XGBoost Objective Function. Available online: https://xgboost.readthedocs.io/en/stable/tutorials/model.html.
66. Artin, E., and Morse, M. (1953). Quota Solutions op n-person Games1, Princeton University Press.
67. SHAP (2022, September 03). SHAP Documentation. SHAP 2017. Available online: https://shap.readthedocs.io/en/latest/index.html.
68. Utilizing support vector machine in real-time crash risk evaluation10.1016/j.aap.2012.11.027 ↗
69. Pillajo-Quijia, G., Arenas-Ramírez, B., González-Fernández, C., and Aparicio-Izquierdo, F. (2020). Influential factors on injury severity for drivers of light trucks and vans with machine learning methods. Sustainability, 12.10.3390/su12041324 ↗
70. Application of support vector machine for crash injury severity prediction: A model comparison approach
71. Shanthi, S., and Ramani, R.G. (2012, January 24–26). Feature relevance analysis and classification of road traffic accident data through data mining techniques. Proceedings of the World Congress on Engineering and Computer Science, San Francisco, CA, USA.
72. Prediction for traffic accident severity: Comparing the artificial neural network, genetic algorithm, combined genetic algorithm and pattern search methods10.3846/16484142.2011.635465 ↗
73. Predicting freeway traffic crash severity using XGBoost-Bayesian network model with consideration of features interaction10.1155/2022/4257865 ↗
74. Liao, Y., Zhang, J., Wang, S., Li, S., and Han, J. (2018). Study on crash injury severity prediction of autonomous vehicles for different emergency decisions based on support vector machine model. Electronics, 7.10.3390/electronics7120381 ↗
75. Sameen, M.I., and Pradhan, B. (2017). Severity prediction of traffic accidents with recurrent neural networks. Appl. Sci., 7.10.3390/app7060476 ↗