Review of Image-Based 3D Reconstruction of Building for Automated Construction Progress Monitoring
Source abstract
Abstract
With the spread of camera-equipped devices, massive images and videos are recorded on construction sites daily, and the ever-increasing volume of digital images has inspired scholars to visually capture the actual status of construction sites from them. Three-dimensional (3D) reconstruction is the key to connecting the Building Information Model and the project schedule to daily construction images, which enables managers to compare as-planned with as-built status and detect deviations and therefore monitor project progress. Many scholars have carried out extensive research and produced a variety of intricate methods. However, few studies comprehensively summarize the existing technologies and introduce the homogeneity and differences of these technologies. Researchers cannot clearly identify the relationship between various methods to solve the difficulties. Therefore, this paper focuses on the general technical path of various methods and sorts out a comprehensive research map, to provide reference for researchers in the selection of research methods and paths. This is followed by identifying gaps in knowledge and highlighting future research directions. Finally, key findings are summarized.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Surveying and Cultural Heritage · Remote Sensing and LiDAR Applications · Infrastructure Maintenance and Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Economic and Management, North China Electric Power University, Beijing 102206, China
State Grid Mianyang Power Supply Company, Mianyang 621000, China
References (82)
Show source-provided references
1. Towards an automated photogrammetry-based approach for monitoring and controlling construction site activities10.1016/j.compind.2018.03.012 ↗
2. Modeling and analysis of the impact of BIM-based field data capturing technologies on automated construction progress monitoring10.1007/s40999-018-0320-1 ↗
3. Application of D4AR–a 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication
4. Interior construction state recognition with 4D BIM registered image sequences10.1016/j.autcon.2017.10.027 ↗
5. Automated digital modeling of existing buildings: A review of visual object recognition methods10.1016/j.autcon.2020.103131 ↗
6. Image-based 3D object reconstruction: State-of-the-art and trends in the deep learning era10.1109/TPAMI.2019.2954885 ↗
7. Rankohi, S., and Waugh, L. (2014, January 28–31). Image-based modeling approaches for projects status comparison. Proceedings of the CSCE 2014 General Conference, Halifax, NS, Canada.
8. Image segmentation using laser radar data10.1016/0031-3203(90)90035-J ↗
9. Helios: A multi-purpose lidar simulation framework for research, planning and training of laser scanning operations with airborne, ground-based mobile and stationary platforms10.5194/isprs-annals-III-3-161-2016 ↗
10. Point cloud quality requirements for scan-vs-BIM based automated construction progress monitoring10.1016/j.autcon.2017.09.021 ↗
11. Hong, S., Park, I., Lee, J., Lim, K., Choi, Y., and Sohn, H.-G. (2017). Utilization of a terrestrial laser scanner for the calibration of mobile mapping systems. Sensors, 17.10.3390/s17030474 ↗
12. Potential of big visual data and building information modeling for construction performance analytics: An exploratory study10.1016/j.autcon.2016.11.004 ↗
13. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
14. Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded up robust features. Computer Vision—ECCV 2006, Proceedings of the 9th European Conference on Computer Vision, Graz, Austria, 7–13 May 2006, Springer.10.1007/11744023_32 ↗
15. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
16. The interpretation of structure from motion
17. Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges10.1016/j.aei.2015.01.012 ↗
18. State of research in automatic as-built modelling10.1016/j.aei.2015.01.001 ↗
19. Big data in the construction industry: A review of present status, opportunities, and future trends10.1016/j.aei.2016.07.001 ↗
20. Data acquisition technologies for construction progress tracking10.1016/j.autcon.2016.06.016 ↗
21. Data acquisition from construction sites for tracking purposes10.1108/09699980910988384 ↗
22. Comparison of optical sensor-based spatial data collection techniques for civil infrastructure modeling10.1061/(ASCE)0887-3801(2009)23:3(170) ↗
23. Computer vision-based interior construction progress monitoring: A literature review and future research directions10.1016/j.autcon.2021.103705 ↗
24. Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques10.1016/j.autcon.2010.06.007 ↗
25. A concept for automated construction progress monitoring using BIM-based geometric constraints and photogrammetric point clouds
26. Progressive 3D reconstruction of infrastructure with videogrammetry10.1016/j.autcon.2011.03.005 ↗
27. Integrating automated data acquisition technologies for progress reporting of construction projects10.1016/j.autcon.2010.12.001 ↗
28. Achievements and challenges in machine vision-based inspection of large concrete structures10.1260/1369-4332.17.3.303 ↗
29. Deconstruction project planning of existing buildings based on automated acquisition and reconstruction of building information10.1016/j.autcon.2018.03.017 ↗
30. Appearance-based material classification for monitoring of operation-level construction progress using 4D BIM and site photologs10.1016/j.autcon.2015.02.007 ↗
31. Xiao, D. (2015). Application and development of BIM Technology in spatial structure. [Master’s Thesis, Shanghai Jiaotong University].
32. Towards automated progress assessment of workpackage components in construction projects using computer vision10.1016/j.aei.2008.07.002 ↗
33. Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs10.1061/(ASCE)0887-3801(2009)23:6(391) ↗
34. Using a real-time integrated communication system to monitor the progress and quality of construction works10.1016/j.autcon.2008.02.003 ↗
35. Automated progress monitoring using unordered daily construction photographs and IFC-based building information models10.1061/(ASCE)CP.1943-5487.0000205 ↗
36. Visual monitoring of civil infrastructure systems via camera-equipped unmanned aerial vehicles (UAVs): A review of related works10.1186/s40327-015-0029-z ↗
37. Álvares, J.S., and Costa, D.B. (2018, January 16–22). Literature review on visual construction progress monitoring using unmanned aerial vehicles. Proceedings of the 26th Annual Conference of the International Group for Lean Construction, IGLC, Chennai, India.10.24928/2018/0310 ↗
38. Automated continuous construction progress monitoring using multiple workplace real time 3D scans10.1016/j.aei.2018.06.001 ↗
39. 3D facilities: Annotated 3D reconstructions of building facilities
40. On-demand monitoring of construction projects through a game-like hybrid application of BIM and machine learning10.1016/j.autcon.2019.103012 ↗
41. Comparison of construction photograph and VR image in construction progress10.1016/j.autcon.2006.12.005 ↗
42. 4-Plane congruent sets for automatic registration of as-is 3D point clouds with 3D BIM models10.1016/j.autcon.2018.01.014 ↗
43. A CNN-based 3D patch registration approach for integrating sequential models in support of progress monitoring10.1016/j.aei.2019.100923 ↗
44. Real-time image localization and registration with BIM Using perspective alignment for indoor monitoring of construction10.1061/(ASCE)CP.1943-5487.0000847 ↗
45. Layouts from panoramic images with geometry and deep learning10.1109/LRA.2018.2850532 ↗
46. Computational methods of acquisition and processing of 3D point cloud data for construction applications10.1007/s11831-019-09320-4 ↗
47. Pairwise linkage for point cloud segmentation10.5194/isprs-annals-III-3-201-2016 ↗
48. User exemplar-based building element retrieval from raw point clouds using deep point-level features10.1016/j.autcon.2020.103159 ↗
49. Parallel edge-region-based segmentation algorithm targeted at reconfigurable multiring network10.1023/A:1022804606389 ↗
50. Deep learning approach to point cloud scene understanding for automated scan to 3D reconstruction10.1061/(ASCE)CP.1943-5487.0000842 ↗
51. Octree-based region growing for point cloud segmentation10.1016/j.isprsjprs.2015.01.011 ↗
52. Strom, J., Richardson, A., and Olson, E. (2010, January 18–22). Graph-based segmentation for colored 3D laser point clouds. Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.10.1109/IROS.2010.5650459 ↗
53. Two algorithms for extracting building models from raw laser altimetry data10.1016/S0924-2716(99)00004-0 ↗
54. A methodology for automated segmentation and reconstruction of urban 3-D buildings from ALS point clouds10.1109/JSTARS.2014.2349003 ↗
55. Surface mesh segmentation and smooth surface extraction through region growing10.1016/j.cagd.2005.03.006 ↗
56. Antonello, M., Wolf, D., Prankl, J., Ghidoni, S., Menegatti, E., and Vincze, M. (2018, January 21–26). Multi-view 3D entangled forest for semantic seg-mentation and mapping. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Los Alamitos, CA, USA.10.1109/ICRA.2018.8460837 ↗
57. Posada, L.F., Velasquez-Lopez, A., Hoffmann, F., and Bertram, T. (2018, January 21–26). Semantic mapping with omnidirectional vision. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Los Alamitos, CA, USA.10.1109/ICRA.2018.8461165 ↗
58. An autonomous robotic platform for automatic extraction of detailed semantic models of buildings10.1016/j.autcon.2019.102963 ↗
59. Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections10.1016/j.aei.2013.11.002 ↗
60. 4D CAD model updating using image processing-based construction progress monitoring10.1016/j.autcon.2013.03.005 ↗
61. Parameter optimization for automated concrete detection in image data10.1016/j.autcon.2010.06.008 ↗
62. Geometry- and appearance-based reasoning of construction progress monitoring10.1061/(ASCE)CO.1943-7862.0001428 ↗
63. Towards semantic maps for mobile robots10.1016/j.robot.2008.08.001 ↗
64. Algorithms for automated deduction of topological information10.1016/j.autcon.2004.07.015 ↗
65. Dynamic occlusion detection and inpainting of in situ captured terrestrial laser scanning point clouds sequence10.1016/j.isprsjprs.2016.05.007 ↗
66. Detecting structural components of building engineering based on deep-learning method10.1061/(ASCE)CO.1943-7862.0001751 ↗
67. An object-based 3D walk-through model for interior construction progress monitoring10.1016/j.autcon.2010.07.003 ↗
68. Kropp, C., Koch, C., Brilakis, I., and Knig, M. (2012, January 27–29). A framework for automated delay prediction of finishing works using video data and BIM-based construction simulation. Proceedings of the 14th International Conference on Computing in Civil and Building Engineering (ICCCBE), Moscow, Russia.
69. Automated computer vision-based detection of components of under-construction indoor partitions10.1016/j.autcon.2016.11.009 ↗
70. Automating the creation of building information models for existing buildings10.1016/j.autcon.2019.102838 ↗
71. Li, Y., Li, W., Tang, S., Darwish, W., Hu, Y., and Chen, W. (2020). Automatic indoor as-built building information models generation by using low-cost rgb-d sensors. Sensors, 20.10.3390/s20010293 ↗
72. Advanced damage detection techniques in historical buildings using digital photogrammetry and 3D surface anlysis10.1016/j.culher.2018.09.014 ↗
73. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure10.1016/j.aei.2015.01.008 ↗
74. A deep learning-based method for detecting non-certified work on construction sites10.1016/j.aei.2018.01.001 ↗
75. An investigation on deep learning applications for 3D reconstruction of human movements
76. Integrated detection and tracking of workforce and equipment from construction jobsite videos10.1016/j.autcon.2017.05.005 ↗
77. An intelligent vision-based approach for helmet identification for work safety10.1016/j.compind.2018.03.037 ↗
78. Detecting non-hardhat-use by a deep learning method from far-field surveillance videos10.1016/j.autcon.2017.09.018 ↗
79. Automatic indoor construction process monitoring for tiles based on BIM and computer vision10.1061/(ASCE)CO.1943-7862.0001744 ↗
80. Zhao, C., Sun, L., and Stolkin, R. (2017, January 15). A fully end-to-end deep learning approach for real-time simultaneous 3D reconstruction and material recognition. Proceedings of the 2017 18th International Conference on Advanced Robotics (ICAR), Hong Kong, China.10.1109/ICAR.2017.8023499 ↗
81. Landrieu, L., and Simonovsky, M. (2018, January 18–22). Large-scale point cloud semantic segmentation with superpoint graphs. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Institute of Electrical and Electronics Engineers (IEEE), Salt Lake, UT, USA.10.1109/CVPR.2018.00479 ↗
82. BIM-PoseNet: Indoor camera localisation using a 3D indoor model and deep learning from synthetic images10.1016/j.isprsjprs.2019.02.020 ↗