Classification and application of deep learning in construction engineering and management – A systematic literature review and future innovations
Source abstract
Abstract
In the ever-evolving landscape of construction engineering and management (CEM), the dynamic and unique characteristics of construction project environments constantly present multifaceted challenges. These challenges are characterized by the extensive volume of project-specific information and intricate engineering data. Deep learning (DL), with its advanced analytical capabilities, has been emerging as a robust solution to these complexities. While the application of DL in CEM is on an upward trajectory, a systematic review of its implementation is conspicuously lacking. This paper, therefore, embarks on a scientometric and qualitative analysis of 296 DL-based studies related to CEM from 2014 to 2024 in the renowned data science repositories Scopus, Science Direct and Web of Science to explore the characteristics of journals, keywords and clusters. It is found that six research topics have fully utilized the advantages of DL in CEM in the last decade, including construction equipment management, structural health monitoring, construction site safety management, construction schedule management, worker health management and workforce assessment and intelligent design. Then, the studies under each research topic are summarized separately and a searchable taxonomy is proposed that secondarily categorizes each study according to the specific CEM task and DL method used to facilitate understanding and access. Finally, the primary obstacles encountered in DL itself and in its practical application in CEM are discussed. It further articulates five critical future research directions that are evolving in tandem with advances in CEM, multimodal construction site management, real-time structural health monitoring and prediction, project progress visualization and management, intelligent design with data sharing and the incorporating large language models (LLM) for text data analysis. The three goals of this study are providing CEM researchers and practitioners with an in-depth and nuanced understanding of DL, elucidating the diverse nature of CEM activities and the resulting benefits of applying DL, and identifying future opportunities for applying DL in CEM to inform subsequent ongoing academic inquiry and pragmatic applications.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Occupational Health and Safety Research · BIM and Construction Integration
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Autonomous health assessment of civil infrastructure using deep learning and smart devices10.1016/j.autcon.2022.104396 ↗
2. Deep learning in the construction industry: a review of present status and future innovations
3. Unmanned aerial systems and deep learning for safety and health activity monitoring on construction sites10.3390/s23156690 ↗
4. ModelTracker: Redesigning Performance Analysis Tools for Machine Learning
5. Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data10.1016/j.autcon.2022.104181 ↗
6. A deep-learning-based computer vision solution for construction vehicle detection10.1111/mice.12530 ↗
7. Deep learning-based road damage detection and classification for multiple countries10.1016/j.autcon.2021.103935 ↗
8. Vision transformer-based autonomous crack detection on asphalt and concrete surfaces.10.1016/j.autcon.2022.104316 ↗
9. Expediting life cycle cost analysis of infrastructure assets under multiple uncertainties by deep neural networks10.1061/(ASCE)ME.1943-5479.0000950 ↗
10. Reinforcement learning in construction engineering and management: a review10.1061/(ASCE)CO.1943-7862.0002386 ↗
11. Quantifying hybrid failure modes of unreinforced masonry walls through experimental data analysis10.1061/JSENDH.STENG-13028 ↗
12. Excavator 3D pose estimation using deep learning and hybrid datasets10.1016/j.aei.2023.101875 ↗
13. Image-based reinforced concrete component mechanical damage recognition and structural safety rapid assessment using deep learning with frequency information10.1016/j.autcon.2023.104839 ↗
14. Fatigue and human performance: an updated framework10.1007/s40279-022-01748-2 ↗
15. A flexible classification approach with optimal generalisation performance: support vector machines10.1016/S0169-7439(02)00046-1 ↗
16. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
17. Automated excavators activity recognition and productivity analysis from construction site surveillance videos10.1016/j.autcon.2019.103045 ↗
18. Construction worker productivity evaluation using action recognition for foreign labor training and education: a case study of Taiwan10.1016/j.autcon.2023.104809 ↗
19. Deep learning for intelligent identification of concrete wind-erosion damage10.1016/j.autcon.2022.104427 ↗
20. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders10.1093/occmed/kqi082 ↗
21. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
22. Computing the characteristics of defects in wooden structures using image processing and CNN
23. Automated detection of workers and heavy equipment on construction sites: a convolutional neural network approach10.1016/j.aei.2018.05.003 ↗
24. Detecting non-hardhat-use by a deep learning method from far-field surveillance videos10.1016/j.autcon.2017.09.018 ↗
25. A deep learning fusion approach to retrieve images of People’s unsafe behavior from construction sites
26. A deep learning-based approach for mitigating falls from height with computer vision: convolutional neural network10.1016/j.aei.2018.12.005 ↗
27. Knowledge-enhanced generative adversarial networks for schematic design of framed tube structures10.1016/j.autcon.2022.104619 ↗
28. Integrated schematic design method for shear wall structures: a practical application of generative adversarial networks10.3390/buildings12091295 ↗
29. Intelligent generative design for shear wall cross-sectional size using rule-embedded generative adversarial network10.1061/JSENDH.STENG-12206 ↗
30. Localization and classification of structural damage using deep learning single-channel signal-based measurement10.1016/j.autcon.2022.104271 ↗
31. Construction 4.0: a literature review10.3390/su12229755 ↗
32. Heart rate modeling and prediction of construction workers based on physical activity using deep learning10.1016/j.autcon.2023.105077 ↗
33. Automated modular housing design using a module configuration algorithm and a coupled generative adversarial network (CoGAN)10.1016/j.autcon.2022.104234 ↗
34. Self-supervised contrastive video representation learning for construction equipment activity recognition on limited dataset10.1016/j.autcon.2023.105001 ↗
35. Model to predict the impact of a technology on construction productivity10.1061/(ASCE)CO.1943-7862.0000328 ↗
36. Automated pixel-level pavement distress detection based on stereo vision and deep learning10.1016/j.autcon.2021.103788 ↗
37. Action recognition based on 3D skeleton and LSTM for the monitoring of construction workers’ safety harness usage10.1061/JCEMD4.COENG-12542 ↗
38. Change detection in unmanned aerial vehicle images for progress monitoring of road construction10.3390/buildings11040150 ↗
39. Safety helmet detection based on YOLOv5 driven by super-resolution reconstruction10.3390/s23041822 ↗
40. Rapid entire body assessment (REBA)10.1016/S0003-6870(99)00039-3 ↗
41. PassGAN: a deep learning approach for password guessing
42. Monitoring safety behaviors of scaffolding workers using Gramian angular field convolution neural network based on IMU sensing data10.1016/j.autcon.2023.104748 ↗
43. Abstraction Hierarchy in Deep Learning Neural Networks
44. Work estimation of construction workers for productivity monitoring using kinematic data and deep learning10.1016/j.autcon.2023.104932 ↗
45. Real-time vision-based worker localization & hazard detection for construction10.1016/j.autcon.2020.103448 ↗
46. Vision-based productivity monitoring of tower crane operations during curtain wall installation using a database-free approach10.1061/JCCEE5.CPENG-5105 ↗
47. 3D convolutional neural network-based one-stage model for real-time action detection in video of construction equipment10.1111/mice.12695 ↗
48. AI-based risk assessment for construction site disaster preparedness through deep learning-based digital twinning10.1016/j.autcon.2021.104091 ↗
49. Analyzing safety risk imposed by jobsite debris to nearby built environments using geometric digital twins and vision-based deep learning10.1061/(ASCE)CP.1943-5487.0001044 ↗
50. Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning10.1016/j.autcon.2020.103291 ↗
51. Measuring and benchmarking the productivity of excavators in infrastructure projects: a deep neural network approach10.1016/j.autcon.2020.103532 ↗
52. Classification and analysis of deep learning applications in construction: a systematic literature review10.1016/j.autcon.2021.103760 ↗
53. Construction work-stage-based rule compliance monitoring framework using computer vision (CV) technology10.3390/buildings13082093 ↗
54. Effective inertial sensor quantity and locations on a body for deep learning-based worker’s motion recognition10.1016/j.autcon.2020.103126 ↗
55. Automatic recognition of workers’ motions in highway construction by using motion sensors and long short-term memory networks10.1061/(ASCE)CO.1943-7862.0002001 ↗
56. Transfer learning and deep convolutional neural networks for safety guardrail detection in 2D images10.1016/j.autcon.2018.01.003 ↗
57. Computer vision and long short-term memory: learning to predict unsafe behaviour in construction10.1016/j.aei.2021.101400 ↗
58. Convolutional neural network modeling strategy for fall-related motion recognition using acceleration features of a scaffolding structure10.1016/j.autcon.2021.103857 ↗
59. Fall-from-height detection using deep learning based on IMU sensor data for accident prevention at construction sites10.3390/s22166107 ↗
60. Construction site safety management: a computer vision and deep learning approach10.3390/s23020944 ↗
61. Active partial label learning based on adaptive sample selection10.1007/s13042-021-01470-x ↗
62. Multiobject real-time automatic detection method for production quality control of prefabricated laminated slabs10.1061/JCEMD4.COENG-14089 ↗
63. High-resolution concrete damage image synthesis using conditional generative adversarial network10.1016/j.autcon.2022.104739 ↗
64. Automated structural design of shear wall residential buildings using generative adversarial networks10.1016/j.autcon.2021.103931 ↗
65. Base-isolation design of shear wall structures using physics-rule-co-guided self-supervised generative adversarial networks10.1002/eqe.3862 ↗
66. Effects of dataset characteristics on the performance of fatigue detection for crane operators using hybrid deep neural networks
67. Deep learning and infrared thermography for asphalt pavement crack severity classification10.1016/j.autcon.2022.104383 ↗
68. Asphalt pavement fatigue crack severity classification by infrared thermography and deep learning10.1016/j.autcon.2022.104575 ↗
69. Automated clash resolution for reinforcement steel design in precast concrete wall panels via generative adversarial network and reinforcement learning10.1016/j.aei.2023.102131 ↗
70. Lightweight convolutional neural network for counting densely piled steel bars10.1016/j.autcon.2022.104692 ↗
71. Automated pavement crack detection and segmentation based on two-step convolutional neural network10.1111/mice.12622 ↗
72. Automatic pixel-level detection of vertical cracks in asphalt pavement based on GPR investigation and improved mask R-CNN10.1016/j.autcon.2022.104689 ↗
73. Applying deep learning and single shot detection in construction site image recognition10.3390/buildings13041074 ↗
74. Recognizing diverse construction activities in site images via relevance networks of construction-related objects detected by convolutional neural networks10.1061/(ASCE)CP.1943-5487.0000756 ↗
75. Towards efficient and objective work sampling: recognizing workers’ activities in site surveillance videos with two-stream convolutional networks10.1016/j.autcon.2018.07.011 ↗
76. Full body pose estimation of construction equipment using computer vision and deep learning techniques10.1016/j.autcon.2019.103016 ↗
77. Research Methodology Used to Investigate the Effects of Noise on Overhead Crane Operator’s Performances
78. Evaluation and optimisation of pre-trained CNN models for asphalt pavement crack detection and classification
79. Deep learning-based construction equipment operators’ mental fatigue classification using wearable EEG sensor data10.1016/j.aei.2023.101978 ↗
80. Human intrusion detection in static hazardous areas at construction sites: deep learning–based method10.1061/(ASCE)CO.1943-7862.0002409 ↗
81. Deep learning-based active noise control on construction sites10.1016/j.autcon.2023.104885 ↗
82. A systematic review of the digital transformation of the building construction industry10.1109/ACCESS.2024.3365934 ↗
83. Deep learning for site safety: real-time detection of personal protective equipment.10.1016/j.autcon.2020.103085 ↗
84. House-GAN++: Generative Adversarial Layout Refinement Network towards Intelligent Computational Agent for Professional Architects
85. A Generative adversarial learning strategy for enhanced lightweight crack delineation networks10.1016/j.aei.2022.101575 ↗
86. Zernike-moment measurement of thin-crack width in images enabled by dual-scale deep learning10.1111/mice.12421 ↗
87. Activity-level construction progress monitoring through semantic segmentation of 3D-informed orthographic images
88. Roles of artificial intelligence in construction engineering and management: a critical review and future trends
89. Blockchain and deep learning technologies for construction equipment security information management
90. Bottleneck detection in modular construction factories using computer vision10.3390/s23083982 ↗
91. Patch-based crack detection in black box images using convolutional neural networks10.1061/(ASCE)CP.1943-5487.0000831 ↗
92. Gestalt: integrated support for implementation and analysis in machine learning
93. Use of convolutional networks in the conceptual structural design of shear wall buildings layout10.1016/j.engstruct.2021.112311 ↗
94. Structural design of reinforced concrete buildings based on deep neural networks10.1016/j.engstruct.2021.112377 ↗
95. A self-sparse generative adversarial network for autonomous early-stage design of architectural sketches10.1111/mice.12759 ↗
96. Real-time detection of cracks in tiled sidewalks using YOLO-based method applied to unmanned aerial vehicle (UAV) images.10.1016/j.autcon.2023.104745 ↗
97. Times-series data augmentation and deep learning for construction equipment activity recognition10.1016/j.aei.2019.100944 ↗
98. Model-agnostic interpretability of machine learning
99. Detecting safety helmet wearing on construction sites with bounding-box regression and deep transfer learning10.1111/mice.12579 ↗
100. Road damage detection using super-resolution and semi-supervised learning with generative adversarial network10.1016/j.autcon.2022.104139 ↗