journal article·2023-01-11Open access

Image-Based Structural Health Monitoring: A Systematic Review

John Mark Go Payawal, Dong-Keon Kim

Applied Sciences· Volume 13· Issue 2

Abstract

The early discovery of factors that compromise a civil infrastructure’s structural integrity allows for safety monitoring, timely prevention, and a prompt remedy to the discovered problem. As a result, researchers have been researching various methodologies and types of structural health monitoring (SHM). A systematic search was performed following the updated Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA 2020) in Scopus and ScienceDirect from Elsevier, Google Scholar, MDPI, Springer, Wiley Online and ASCE Library, EOP and IOP Science, IEEE, and other databases with the reliable peer review process. From 1480 identified pieces of literature, one hundred and nine (109) sources met the criteria for inclusion and exclusion and were used to produce our findings. This study presents the identified purpose and application of image-based SHM, which includes: (1) identifying and discovering; (2) measuring and monitoring; (3) automating and increasing efficiency; and (4) promoting development and creating 3D models. Furthermore, the responsibilities and relevance of components and parameters for implementing image-based SHM devices and systems, and their issues, are covered in this paper. Future research can benefit from the stated applications for innovation and the requirements of image-based SHM.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Structural Health Monitoring Techniques · Concrete Corrosion and Durability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of ICT Integrated Ocean Smart Cities Engineering, Dong-A University, Busan 49304, Republic of Korea

National Core Research Center for Disaster-Free and Safe Ocean Cities Construction, Dong-A University, Busan 49304, Republic of Korea

Funding

National Research Foundation (NRF) funded by the Korea Ministry of Education

References (100+)

Show source-provided references
1. Azimi, M., Eslamlou, A., and Pekcan, G. (2020). Data-Driven Structural Health Monitoring and Damage Detection through Deep Learning: State-of-the-Art Review. Sensors, 20.10.3390/s20102778 ↗
2. The State of the Art of Data Science and Engineering in Structural Health Monitoring10.1016/j.eng.2018.11.027 ↗
3. State-of-the-Art in Structural Health Monitoring of Large and Complex Civil Infrastructures10.1007/s13349-015-0108-9 ↗
4. Structural Health Monitoring—What Is the Prescription?10.1016/j.mechrescom.2008.08.011 ↗
5. Sustainable Structural Health Monitoring System10.1002/stc.79 ↗
6. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks: Deep Learning-Based Crack Damage Detection Using CNNs10.1111/mice.12263 ↗
7. Long-Term Monitoring of High-Rise Buildings Connected by Link Bridges10.1007/s13349-013-0045-4 ↗
8. Experimental Validation of Cost-Effective Vision-Based Structural Health Monitoring10.1016/j.ymssp.2016.11.021 ↗
9. Visual Structural Inspection Datasets10.1016/j.autcon.2022.104299 ↗
10. Completely Contactless Structural Health Monitoring of Real-Life Structures Using Cameras and Computer Vision: Structural Health Monitoring Using Computer Vision10.1002/stc.1852 ↗
11. Health Monitoring of Civil Structures with Integrated UAV and Image Processing System10.1016/j.procs.2015.06.058 ↗
12. Uncertainty-assisted Deep Vision Structural Health Monitoring10.1111/mice.12580 ↗
13. Zhou, H., Xu, C., Tang, X., Wang, S., and Zhang, Z. (2022). A Review of Vision-Laser-Based Civil Infrastructure Inspection and Monitoring. Sensors, 22.10.3390/s22155882 ↗
14. Salman, M., Mathavan, S., Kamal, K., and Rahman, M. (2013, January 6–9). Pavement Crack Detection Using the Gabor Filter. Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), The Hague, Netherlands.10.1109/ITSC.2013.6728529 ↗
15. CrackTree: Automatic Crack Detection from Pavement Images10.1016/j.patrec.2011.11.004 ↗
16. Pothole Detection in Asphalt Pavement Images10.1016/j.aei.2011.01.002 ↗
17. Fu, J., Zhu, X., and Li, Y. (2019). Recognition Of Surface Defects On Steel Sheet Using Transfer Learning. arXiv.
18. Concrete Crack Detection by Multiple Sequential Image Filtering: Concrete Crack Detection by Image Processing10.1111/j.1467-8667.2011.00716.x ↗
19. Sustainability-Informed Multi-Criteria Decision Support Framework for Ranking and Prioritization of Pavement Sections10.1016/j.jclepro.2019.118755 ↗
20. Development and Field Testing of a Vision-Based Displacement System Using a Low Cost Wireless Action Camera10.1016/j.ymssp.2018.11.015 ↗
21. Automatic Control of a ROV for Inspection of Underwater Structures Using a Low-Cost Sensing10.1007/s40430-014-0153-z ↗
22. Design of a New Low-Cost Unmanned Aerial Vehicle and Vision-Based Concrete Crack Inspection Method10.1177/1475921719898862 ↗
23. Design and Research of Low-Cost and Self-Adaptive Terrestrial Laser Scanning for Indoor Measurement Based on Adaptive Indoor Measurement Scanning Strategy and Structural Characteristics Point Cloud Segmentation10.1155/2022/5681771 ↗
24. Grosso, A.E.D. (2013, January 9–11). Structural Health Monitoring: Research and Practice. Proceedings of the SMAR 2013 the 2nd Conference on Smart Monitoring, Assessment and Rehabilitation of Civil Structures, Istanbul, Türkiye.
25. PRISMA 2020: An Update10.1016/j.pedhc.2021.04.011 ↗
26. Systematic Reviews in Engineering Education: A Catalyst for Change10.1080/03043797.2021.1980770 ↗
27. A Systematic Review of Passive Energy Consumption Optimisation Strategy Selection for Buildings through Multiple Criteria Decision-Making Techniques10.1016/j.rser.2022.113013 ↗
28. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews10.1186/s13643-021-01626-4 ↗
29. Formulation of Research Question—Stepwise Approach10.4103/jiaps.JIAPS_76_18 ↗
30. Formulation of a Research Question10.7713/ijms.2011.0047 ↗
31. How-to Conduct a Systematic Literature Review: A Quick Guide for Computer Science Research10.1016/j.mex.2022.101895 ↗
32. Study on a Health Monitoring and Defect Imaging Technology of Special Equipment That Is Based on Optical Fiber Ultrasonic Sensing10.1016/j.yofte.2020.102393 ↗
33. Computer Vision for SHM of Civil Infrastructure: From Dynamic Response Measurement to Damage Detection—A Review10.1016/j.engstruct.2017.11.018 ↗
34. Structural Health Monitoring and Seismic Response Assessment of Bridge Structures Using Target-Tracking Digital Image Correlation10.1016/j.engstruct.2020.110551 ↗
35. Guided Wave Based Structural Health Monitoring: A Review10.1088/0964-1726/25/5/053001 ↗
36. Statistical Wavelet-Based Method for Structural Health Monitoring10.1061/(ASCE)0733-9445(2004)130:7(1055) ↗
37. Application of Wavelet Approach for ASCE Structural Health Monitoring Benchmark Studies10.1061/(ASCE)0733-9399(2004)130:1(96) ↗
38. Strategies for Guided-Wave Structural Health Monitoring
39. Summary Review of GPS Technology for Structural Health Monitoring10.1061/(ASCE)ST.1943-541X.0000475 ↗
40. A Review of Machine Vision-Based Structural Health Monitoring: Methodologies and Applications10.1155/2016/7103039 ↗
41. Sensors Used in Structural Health Monitoring10.1007/s11831-017-9217-4 ↗
42. Fibre Optic Sensors for the Structural Health Monitoring of Building Structures10.1016/j.protcy.2016.08.065 ↗
43. Sensor Network Paradigms for Structural Health Monitoring10.1002/stc.125 ↗
44. A Literature Review of Next-Generation Smart Sensing Technology in Structural Health Monitoring10.1002/stc.2321 ↗
45. Structural Health Monitoring Framework Based on Internet of Things: A Survey10.1109/JIOT.2017.2664072 ↗
46. IoT for Structural Health Monitoring10.1109/MIM.2018.8573586 ↗
47. Subsurface Damage Detection and Structural Health Monitoring Using Digital Image Correlation and Topology Optimization10.1016/j.engstruct.2020.111712 ↗
48. Sangirardi, M., Altomare, V., De Santis, S., and de Felice, G. (2022). Detecting Damage Evolution of Masonry Structures through Computer-Vision-Based Monitoring Methods. Buildings, 12.10.3390/buildings12060831 ↗
49. Motion Magnification Analysis for Structural Monitoring of Ancient Constructions10.1016/j.measurement.2018.07.055 ↗
50. Phase-Based Video Motion Processing10.1145/2461912.2461966 ↗
51. Fioriti, V., Roselli, I., Cataldo, A., Forliti, S., Colucci, A., Baldini, M., and Picca, A. (2022). Motion Magnification Applications for the Protection of Italian Cultural Heritage Assets. Sensors, 22.10.3390/s22249988 ↗
52. Fromme, P., and Su, Z. (May, January 23). Motion Magnification for Optical-Based Structural Health Monitoring. Proceedings of the Health Monitoring of Structural and Biological Systems IX, Online.
53. A Comparative Analysis of Imaging Processing Techniques for Non-Invasive Structural Health Monitoring10.1016/j.ifacol.2022.10.503 ↗
54. Glisic, B., and Inaudi, D. (2007). Fibre Optic Methods for Structural Health Monitoring, John Wiley & Sons.10.1002/9780470517819 ↗
55. Glisic, B., Inaudi, D., Kronenberg, P., and Vurpillot, S. (1999, January 18–19). Dam Monitoring Using Long SOFO Sensor. Proceedings of the Hydropower into Next Century, Gmunden, Austria.
56. Monitoring a Subterranean Structure with the Sofo System
57. SOFO: Tunnel Monitoring with Fiber Optic Sensors
58. Displacement Monitoring of a Pedestrian Bridge Using 3D Digital Image Correlation10.1016/j.prostr.2022.02.022 ↗
59. Kim, B., and Cho, S. (2018). Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique. Sensors, 18.10.3390/s18103452 ↗
60. Structural Health Monitoring and Inspection of Dams Based on UAV Photogrammetry with Image 3D Reconstruction10.1016/j.autcon.2021.103832 ↗
61. A Novel Intelligent Inspection Robot with Deep Stereo Vision for Three-Dimensional Concrete Damage Detection and Quantification10.1177/14759217211010238 ↗
62. A Computer Vision-Based Method for Bridge Model Updating Using Displacement Influence Lines10.1016/j.engstruct.2022.114129 ↗
63. Measurement of Local Deformations in Steel Monostrands Using Digital Image Correlation10.1061/(ASCE)BE.1943-5592.0000615 ↗
64. Sensing Dynamic Displacements in Masonry Rail Bridges Using 2D Digital Image Correlation10.1002/stc.2187 ↗
65. An Algorithm for Structural Health Monitoring by Digital Image Correlation: Proof of Concept and Case Study10.1016/j.optlaseng.2021.106842 ↗
66. Displacement Monitoring of Crossbeams in an Airport Runway Extension Using Digital Image Correlation10.1016/j.prostr.2022.01.072 ↗
67. Digital Image Correlation: From Displacement Measurement to Identification of Elastic Properties—A Review10.1111/j.1475-1305.2006.00258.x ↗
68. Computer Vision-Based, Noncontacting Deformation Measurements in Mechanics: A Generational Transformation10.1115/1.4024984 ↗
69. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types: Autonomous SHM Using Deep Faster R-CNN10.1111/mice.12334 ↗
70. Lv, X., Duan, F., Jiang, J., Fu, X., and Gan, L. (2020). Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network. Sensors, 20.10.3390/s20061562 ↗
71. Defect Sizing in Guided Wave Imaging Structural Health Monitoring Using Convolutional Neural Networks10.1016/j.ndteint.2021.102480 ↗
72. An Evaluation of Image-Based Structural Health Monitoring Using Integrated Unmanned Aerial Vehicle Platform10.1002/stc.2276 ↗
73. Swaying Displacement Measurement for Structural Monitoring Using Computer Vision and an Unmanned Aerial Vehicle10.1016/j.measurement.2020.107769 ↗
74. Integration of Computer Imaging and Sensor Data for Structural Health Monitoring of Bridges10.1088/0964-1726/19/1/015019 ↗
75. Long-Term Structural Performance Monitoring System for the Shanghai Tower10.1007/s13349-012-0034-z ↗
76. 3D Displacement Measurement Model for Health Monitoring of Structures Using a Motion Capture System10.1016/j.measurement.2014.09.063 ↗
77. Application of Digital Photogrammetry Techniques in Identifying the Mode Shape Ratios of Stay Cables with Multiple Camcorders10.1016/j.measurement.2015.07.037 ↗
78. Information Systems Strategy: Reconceptualization, Measurement, and Implications10.2307/20721426 ↗
79. Malik, H., Khattak, K.S., Wiqar, T., Khan, Z.H., and Altamimi, A.B. (2019, January 29–30). Low Cost Internet of Things Platform for Structural Health Monitoring. Proceedings of the 2019 22nd International Multitopic Conference (INMIC), Islamabad, Pakistan.10.1109/INMIC48123.2019.9022801 ↗
80. A New Joint Application of Non-Invasive Remote Sensing Techniques for Structural Health Monitoring10.1088/1742-2132/9/4/S53 ↗
81. Interferometric Radar vs. Accelerometer for Dynamic Monitoring of Large Structures: An Experimental Comparison10.1016/j.ndteint.2007.11.002 ↗
82. Output-Only Modal Identification of a Reinforced Concrete Bridge from Radar-Based Measurements10.1016/j.ndteint.2008.04.005 ↗
83. Vision-Based Automated Crack Detection for Bridge Inspection: Vision-Based Automated Crack Detection for Bridge Inspection10.1111/mice.12141 ↗
84. Infrared Thermography for Civil Structural Assessment: Demonstrations with Laboratory and Field Studies10.1007/s13349-016-0180-9 ↗
85. Real Time Implementation of Image Enhancement Based on 2D-DWT10.1016/j.procs.2016.05.134 ↗
86. Image Enhancement Using MCNP5 Code and MATLAB in Neutron Radiography10.1016/j.apradiso.2014.02.004 ↗
87. The MathWorks Inc. (MATLAB) (2022). Academic Use (R2010a), The MathWorks Inc.
88. Tian, L., and Pan, B. (2016). Remote Bridge Deflection Measurement Using an Advanced Video Deflectometer and Actively Illuminated LED Targets. Sensors, 16.10.3390/s16091344 ↗
89. Vision-Based Monitoring System for Evaluating Cable Tensile Forces on a Cable-Stayed Bridge10.1177/1475921713500513 ↗
90. Structural Health Monitoring (SHM) and Nondestructive Testing (NDT) of Slender Masonry Structures: A Practical Review10.1016/j.conbuildmat.2021.123768 ↗
91. Khuc, T., and Catbas, F.N. (2015, January 7–9). Vision-Based for Bridge Structural Health Monitoring and Identification. Proceedings of the SMAR 2015-Third Conference on Smart Monitoring, Assessment and Rehabilitation of Civil Structures, Antalya, Türkiye.
92. Structural Health Monitoring and Damage Detection through Machine Learning Approaches10.1051/e3sconf/202022001096 ↗
93. 2D Image-Based Crack Monitoring: An Affordable, Sufficient and Non-Invasive Technique for the Democratization of Preventive Conservation of Listed Buildings10.1186/s40494-022-00780-9 ↗
94. Combination of Image-Based Documentation and Augmented Reality for Structural Health Monitoring and Building Pathology10.3389/fbuil.2019.00050 ↗
95. Ozer, E., and Feng, M.Q. (2020). Structural Health Monitoring. Start-Up Creation, Elsevier.10.1016/B978-0-12-819946-6.00013-8 ↗
96. Numerical Investigation on Fracture Evolution of Asphalt Mixture Compared with Acoustic Emission10.1080/10298436.2021.1902524 ↗
97. Exploring the Effects of Particle Shape and Content of Fines on the Shear Behavior of Sand-Fines Mixtures via the DEM10.1016/j.compgeo.2018.10.021 ↗
98. Wang, L., Yao, Y., Li, J., Tao, Y., and Liu, K. (2022). Review of Visualization Technique and Its Application of Road Aggregates Based on Morphological Features. Appl. Sci., 12.10.3390/app122010571 ↗
99. Chernov, A.V., Savvas, I.K., Alexandrov, A.A., Kartashov, O.O., Polyanichenko, D.S., Butakova, M.A., and Soldatov, A.V. (2022). Integrated Video and Acoustic Emission Data Fusion for Intelligent Decision Making in Material Surface Inspection System. Sensors, 22.10.3390/s22218554 ↗
100. Current Challenges with BIGDATA Analytics in Structural Health Monitoring