journal article·2023-10-28Open access

Analytical Method for Bridge Damage Using Deep Learning-Based Image Analysis Technology

Kukjin Jang, Taegeon Song, Dasran Kim, Jinsick Kim, Byeongsoo Koo, Moonju Nam, Kyungil Kwak, Jooyeoun Lee, Myoungsug Chung

Applied Sciences· Volume 13· Issue 21

Abstract

Bridge inspection methods using unmanned vehicles have been attracting attention. In this study, we devised an efficient and reliable method for visually inspecting bridges using unmanned vehicles. For this purpose, we developed the BIRD U-Net algorithm, which is an evolution of the U-Net algorithm that utilizes images taken by unmanned vehicles. Unlike the U-Net algorithm, however, this algorithm identifies the optimal function by setting the epoch to 120 and uses the Adam optimization algorithm. In addition, a bilateral filter was applied to highlight the damaged areas of the bridge, and a different color was used for each of the five types of abnormalities detected, such as cracks. Next, we trained and tested 135,696 images of exterior bridge damage, including concrete delamination, water leakage, and exposed rebar. Through the analysis, we confirmed an analysis method that yields an average inspection reproduction rate of more than 95%. In addition, we compared and analyzed the inspection reproduction rate of the method with that of BIRD U-Net after using the same method and images for training as the existing U-Net and ResNet algorithms for validation. In addition, the algorithm developed in this study is expected to yield objective results through automatic damage analysis. It can be applied to regular inspections that involve unmanned mobile vehicles in the field of bridge maintenance, thereby reducing the associated time and cost.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Structural Health Monitoring Techniques · 3D Surveying and Cultural Heritage

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Research Center for Science and Technology Policy and Convergence, Ajou University, Suwon 16499, Republic of Korea

Neongkul Mobile, Suwon 16573, Republic of Korea

Department of Industrial Engineering, Ajou University, Suwon 16499, Republic of Korea

Funding

Science and Technology Policy Expert Development and Support Program through the Ministry of Science and ICT of Korean government

References (27)

Show source-provided references
1. Golding, V.P., Gharineiat, Z., Munawar, H.S., and Ullah, F. (2022). Crack Detection in Concrete Structures using Deep Learning. Sustainability, 14.10.3390/su14138117 ↗
2. A Study of Railway Bridge Automatic Damage Analysis Method using Unmanned Aerial Vehicle and Deep Learning-Based Image Analysis Technology
3. Deep learning: Survey of environmental and camera impacts on internet of things images10.1007/s10462-023-10405-7 ↗
4. Lovelace, B., and Zink, J. (2015). Unmanned Aerial Vehicle Bridge Inspection Demonstration Project, Minnesota Department of Transportation Research Services & Library. Report no. 40.
5. Chanda, S., Bu, G., Guan, H., Jo, J., Pal, U., Loo, Y., and Blumenstein, M. (2014, January 6–8). Automatic Bridge Crack Detection–a Texture Analysis-Based Approach. Proceedings of the Artificial Neural Networks in Pattern Recognition: 6th IAPR TC 3 International Workshop, ANNPR 2014, Montreal, QC, Canada. Proceedings 6.
6. Usability Assessment of Drone Technology as Safety Inspection Tools
7. Applicability of Unmanned Aerial System (UAS) for Safety Inspection on Construction Sites10.1016/j.ssci.2017.06.008 ↗
8. Smart facility maintenance using unmanned vehicles
9. Case Study on the Safety Inspection using Drones
10. A Study on the Method of Facility Management and the Effectiveness of 3D Mapping using Drone in Large Areas
11. Wu, Q., Song, Z., Chen, H., Lu, Y., and Zhou, L. (2023). A Highway Pavement Crack Identification Method Based on an Improved U-Net Model. Appl. Sci., 13.10.3390/app13127227 ↗
12. Hadinata, P.N., Simanta, D., Eddy, L., and Nagai, K. (2023). Multiclass Segmentation of Concrete Surface Damages Using U-Net and DeepLabV3+. Appl. Sci., 13.10.3390/app13042398 ↗
13. Preliminary Research for Drone Based Visual-Safety Inspection of Bridge
14. State-of-the-art deep learning algorithms: Focusing on civil engineering applications
15. Deep learning based multiple damage type detection system for bridge structures
16. A Deep Learning-Based Bridge Image Pretreatment and Damaged Objects Automatic Detection Model for Bridge Damage Management
17. Physical interpretation of machine learning-based recognition of defects for the risk management of existing bridge heritage10.1016/j.engfailanal.2023.107237 ↗
18. Vision-Based Automated Crack Detection using Convolutional Neural Networks for Condition Assessment of Infrastructure10.1177/1475921720965445 ↗
19. Automatic Crack Classification and Segmentation on Masonry Surfaces using Convolutional Neural Networks and Transfer Learning10.1016/j.autcon.2021.103606 ↗
20. Machine Learning Techniques for Robotic and Autonomous Inspection of Mechanical Systems and Civil Infrastructure10.1007/s43684-022-00025-3 ↗
21. Dilated Light-Head R-CNN using Tri-Center Loss for Driving Behavior Recognition10.1016/j.imavis.2019.08.004 ↗
22. Bui, H.M., Lech, M., Cheng, E., Neville, K., and Burnett, I.S. (2016, January 27–29). Using Grayscale Images for Object Recognition with Convolutional-Recursive Neural Network. Proceedings of the 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE), Ha Long, Vietnam.10.1109/CCE.2016.7562656 ↗
23. Xie, Y., and Richmond, D. (2018). Computer Vision—ECCV 2018 Workshops. ECCV 2018. Lecture Notes in Computer Science, Springer.
24. Shahriar, M.T., and Li, H. (2020). A Study of Image Pre-Processing for Faster Object Recognition. arXiv.
25. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
26. Ronneberger, O., Fischer, P., and Brox, T. (2015). Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, 5–9 October 2015, Springer. Part III 18.
27. Yu, X., Kuan, T.-W., Tseng, S.-P., Chen, Y., Chen, S., Wang, J.-F., Gu, Y., and Chen, T. (2023). EnRDeA U-Net Deep Learning of Semantic Segmentation on Intricate Noise Roads. Entropy, 25.10.3390/e25071085 ↗