Highway Construction Safety Analysis Using Large Language Models
Source abstract
Abstract
The highway construction industry carries substantial safety risks for workers, necessitating thorough accident analyses to implement effective preventive measures. Current research lacks comprehensive investigations into safety incidents, relying heavily on conventional statistical methods and overlooking valuable textual information in publicly available databases. This study leverages a state-of-the-art large language model (LLM), specifically OpenAI’s GPT-3.5 model. The primary focus is to enhance text-based incident analysis that is sourced from OSHA’s Severe Injury Reports (SIR) database. By incorporating novel natural language processing (NLP) techniques, dimensionality reduction, clustering algorithms, and LLM prompting of incident narratives, the study aims to develop an approach to the analysis of major accident causes in highway construction. The resulting cluster analysis, coupled with LLM summarization and cause identification, reveals the major accident types, such as heat-related and struck-by injuries, as well as commonalities between incidents. This research showcases the potential of artificial intelligence (AI) and LLM technology in data-driven analysis. By efficiently processing textual data and providing insightful analysis, the study fosters practical implications for safety professionals and the development of more effective accident prevention and intervention strategies within the industry.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Occupational Health and Safety Research · Risk and Safety Analysis · Safety Warnings and Signage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Civil and Environmental Engineering, University of Pittsburgh, Pittsburgh, PA 15261, USA
Department of Civil Engineering Technology, Environmental Management and Safety, Rochester Institute of Technology, Rochester, NY 14623, USA
Funding
University of Pittsburgh Anthony Gill Chair · Impactful Resilient Infrastructure Science & Engineering (IRISE) Consortium
References (44)
Show source-provided references
1. Developing a Pre-Task Safety Briefing Tool for Kentucky Maintenance Personnel10.1177/0361198118792327 ↗
2. Worker safety and injury severity analysis of earthmoving equipment accidents10.1016/j.jsr.2018.02.008 ↗
3. Predicting Ability of Dynamic Balance in Construction Workers Based on Demographic Information and Anthropometric Dimensions10.1016/j.shaw.2021.07.009 ↗
4. Occupational Injuries among construction workers by age and related economic loss: Findings from Ohio workers’ compensation, USA: 2007–201710.1016/j.shaw.2023.10.003 ↗
5. Diagnosis of Encroachment-Related Work-Zone Crashes by Applying Pattern Recognition10.1177/03611981231152254 ↗
6. The Nature of Struck-by Accidents10.1061/(ASCE)0733-9364(2005)131:2(262) ↗
7. Valcamonico, D., Baraldi, P., Amigoni, F., and Zio, E. (2022). A framework based on Natural Language Processing and Machine Learning for the classification of the severity of road accidents from reports. Proc. Inst. Mech. Eng. Part O J. Risk Reliab.10.1177/1748006X221140196 ↗
8. Identification, analysis and dissemination of information on near misses: A case study in the construction industry10.1016/j.ssci.2009.06.006 ↗
9. Analyzing Arizona OSHA Injury Reports Using Unsupervised Machine Learning10.1016/j.proeng.2016.04.200 ↗
10. Extraction of Construction Quality Requirements from Textual Specifications via Natural Language Processing10.1177/03611981211001385 ↗
11. Automated text classification of near-misses from safety reports: An improved deep learning approach10.1016/j.aei.2020.101060 ↗
12. Accident causation models: A comparison of SCM and 24Model
13. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., and Polosukhin, I. (2017). Attention is All you Need, Curran Associates Inc.
14. Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., and Fedus, W. (2022). Emergent Abilities of Large Language Models. arXiv.
15. Decision support system for safety improvement: An approach using multiple correspondence analysis, t-SNE algorithm and K-means clustering10.1016/j.cie.2018.12.044 ↗
16. Alateeq, M.M., Fathimathul Rajeena, P.P., and Ali, M.A.S. (2023). Construction Site Hazards Identification Using Deep Learning and Computer Vision. Sustainability, 15.10.3390/su15032358 ↗
17. Optimal allocation of resources in construction safety: Analytical-empirical model10.1016/j.ssci.2018.01.005 ↗
18. Uddin, S.M.J., Albert, A., Ovid, A., and Alsharef, A. (2023). Leveraging ChatGPT to Aid Construction Hazard Recognition and Support Safety Education and Training. Sustainability, 15.10.3390/su15097121 ↗
19. Li, J., and Wu, C. (2023). Deep Learning and Text Mining: Classifying and Extracting Key Information from Construction Accident Narratives. Appl. Sci., 13.10.3390/app131910599 ↗
20. Enhancing Construction Site Safety: Natural Language Processing for Hazards Identification and Prevention
21. Intelligent technologies for construction machinery using data-driven methods10.1016/j.autcon.2022.104711 ↗
22. Yoo, B., Kim, J., Park, S., Ahn, C.R., and Oh, T. (2024). Harnessing Generative Pre-Trained Transformers for Construction Accident Prediction with Saliency Visualization. Appl. Sci., 14.10.3390/app14020664 ↗
23. Ganguli, R., Miller, P., and Pothina, R. (2021). Effectiveness of Natural Language Processing Based Machine Learning in Analyzing Incident Narratives at a Mine. Minerals, 11.10.3390/min11070776 ↗
24. Shen, Q., Wu, S., Deng, H., and Cheng, J.C.P. (2022). BIM-Based Dynamic Construction Safety Rule Checking Using Ontology and Natural Language Processing. Buildings, 12.10.3390/buildings12050564 ↗
25. Hong, Y., Xie, H., Bhumbra, G., and Brilakis, I. (2021). Comparing Natural Language Processing Methods to Cluster Construction Schedules. J. Constr. Eng. Manag., 147.10.1061/(ASCE)CO.1943-7862.0002165 ↗
26. Construction accident narrative classification: An evaluation of text mining techniques10.1016/j.aap.2017.08.026 ↗
27. Ricketts, J., Barry, D., Guo, W., and Pelham, J. (2023). A Scoping Literature Review of Natural Language Processing Application to Safety Occurrence Reports. Safety, 9.10.3390/safety9020022 ↗
28. Prieto, S.A., Mengiste, E.T., and García de Soto, B. (2023). Investigating the Use of ChatGPT for the Scheduling of Construction Projects. Buildings, 13.10.3390/buildings13040857 ↗
29. Li, G., and Wang, X. (2023). Construction and Path of Urban Public Safety Governance and Crisis Management Optimization Model Integrating Artificial Intelligence Technology. Sustainability, 15.10.3390/su15097487 ↗
30. Pothina, R., and Ganguli, R. (2023). Contextual Representation in NLP to Improve Success in Accident Classification of Mine Safety Narratives. Minerals, 13.10.3390/min13060770 ↗
31. GPT models in construction industry: Opportunities, limitations, and a use case validation10.1016/j.dibe.2023.100300 ↗
32. Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., and Amodei, D. (2020). Language Models Are Few-Shot Learners, Curran Associates Inc.
33. Topic Modeling in Embedding Spaces10.1162/tacl_a_00325 ↗
34. Reimers, N., and Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks, Association for Computational Linguistics. Available online: http://arxiv.org/abs/1908.10084.10.18653/v1/D19-1410 ↗
35. Distributional Structure10.1080/00437956.1954.11659520 ↗
36. Muennighoff, N., Tazi, N., Magne, L., and Reimers, N. (2023). MTEB: Massive Text Embedding Benchmark, Association for Computational Linguistics. Available online: http://arxiv.org/abs/2210.07316.10.18653/v1/2023.eacl-main.148 ↗
37. Heidarysafa, M., Kowsari, K., Barnes, L., and Brown, D. (2018, January 17–20). Analysis of Railway Accidents’ Narratives Using Deep Learning. Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.10.1109/ICMLA.2018.00235 ↗
38. Neelakantan, A., Xu, T., Puri, R., Radford, A., Han, J.M., Tworek, J., and Weng, L. (2022). Text and Code Embeddings by Contrastive Pre-Training. arXiv.
39. Road accident prediction and model interpretation using a hybrid K-means and random forest algorithm approach10.1007/s42452-020-3125-1 ↗
40. An analytic framework using deep learning for prediction of traffic accident injury severity based on contributing factors10.1016/j.aap.2021.106322 ↗
41. Hazardous Chemical Accident Prevention Based on K-Means Clustering Analysis of Incident Information10.1109/ACCESS.2020.3028235 ↗
42. Viualizing data using t-SNE
43. Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2023, July 17). Improving Language Understanding by Generative Pre-Training. Available online: https://api.semanticscholar.org/CorpusID:49313245.
44. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. (2023, July 17). Language Models Are Unsupervised Multitask Learners. Available online: https://api.semanticscholar.org/CorpusID:16002553.