journal article·2025-08-07Open access

Deep Learning Strategy for UAV-Based Multi-Class Damage Detection on Railway Bridges Using U-Net with Different Loss Functions

Yong-Hyoun Na, Doo-Kie Kim

Applied Sciences· Volume 15· Issue 15

Abstract

Periodic visual inspections are currently conducted to maintain the condition of railway bridges. These inspections rely on direct visual assessments by human inspectors, often requiring specialized equipment such as aerial ladders. However, this method is not only time-consuming and costly but also involves significant safety risks. Therefore, there is a growing need for a more efficient and reliable alternative to traditional visual inspections of railway bridges. In this study, we evaluated and compared the performance of damage detection using U-Net-based deep learning models on images captured by unmanned aerial vehicles (UAVs). The target damage types include cracks, concrete spalling and delamination, water leakage, exposed reinforcement, and paint peeling. To enable multi-class segmentation, the U-Net model was trained using three different loss functions: Cross-Entropy Loss, Focal Loss, and Intersection over Union (IoU) Loss. We compared these methods to determine their ability to distinguish actual structural damage from environmental factors and surface contamination, particularly under real-world site conditions. The results showed that the U-Net model trained with IoU Loss outperformed the others in terms of detection accuracy. When applied to field inspection scenarios, this approach demonstrates strong potential for objective and precise damage detection. Furthermore, the use of UAVs in the inspection process is expected to significantly reduce both time and cost in railway infrastructure maintenance. Future research will focus on extending the detection capabilities to additional damage types such as efflorescence and corrosion, aiming to ultimately replace manual visual inspections of railway bridge surfaces with deep-learning-based methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Structural Health Monitoring Techniques · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Civil and Environmental Engineering, Kongju National University, Cheonan-daero, Seobuk-gu, Cheonan 31080, Chungcheongnam-do, Republic of Korea

Funding

Korea Agency for Infrastructure Technology Advancement (KAIA) · Ministry of Land, Infrastructure and Transport (MOLIT)

References (29)

Show source-provided references
1. Automated bridge surface crack detection and segmentation using computer vision-based deep learning model10.1016/j.engappai.2022.105225 ↗
2. Physical interpretation of machine learning-based recognition of defects for the risk management of existing bridge heritage10.1016/j.engfailanal.2023.107237 ↗
3. A scientometric analysis of drone-based structural health monitoring and new technologies10.1177/13694332241255734 ↗
4. BIM-supported drone path planning for building exterior surface inspection10.1016/j.compind.2023.104019 ↗
5. Ayele, Y.Z., Aliyari, M., Griffiths, D., and Droguett, E.L. (2020). Automatic crack segmentation for UAV-assisted bridge inspection. Energies, 13.10.3390/en13236250 ↗
6. Nasimi, R., Moreu, F., and Fricke, G.M. (2023). Sensor equipped UAS for non-contact bridge inspections: Field application. Sensors, 23.10.3390/s23010470 ↗
7. Torres-Barriuso, J., Lasarte, N., Piñero, I., Roji, E., and Elguezabal, P. (2025). Digitalization of the Workflow for Drone-Assisted Inspection and Automated Assessment of Industrial Buildings for Effective Maintenance Management. Buildings, 15.10.3390/buildings15020242 ↗
8. Hong, S.S., Hwang, C.H., Chung, S.W., and Kim, B.K. (2022). A deep-learning-based bridge damaged object automatic detection model using a bridge member model combination framework. Appl. Sci., 12.10.3390/app122412868 ↗
9. Ma, K., Hao, M., Meng, X., Liu, J., Meng, J., and Xuan, Y. (2024). Coarse–Fine Combined Bridge Crack Detection Based on Deep Learning. Appl. Sci., 14.10.3390/app14125004 ↗
10. An improved U-Net model for concrete crack detection
11. Graph neural networks for simulating crack coalescence and propagation in brittle materials10.1016/j.cma.2022.115021 ↗
12. A novel search strategy-based deep learning for city bridge cracks detection in urban planning10.3103/S0146411622050054 ↗
13. Vision Based Crack Detection in Concrete Structures Using Cutting-Edge Deep Learning Techniques10.18280/ts.390210 ↗
14. A study of railway bridge automatic damage analysis method using unmanned aerial vehicle and deep learning-based image analysis technology
15. Development of automatic crack detection using the Gabor Filter for concrete structures of railway tracks
16. Automatic crack detection on two-dimensional pavement images: An algorithm based on minimal path selection10.1109/TITS.2015.2477675 ↗
17. Kyslytsyna, A., Xia, K., Kislitsyn, A., Abd El Kader, I., and Wu, Y. (2021). Road surface crack detection method based on conditional generative adversarial networks. Sensors, 21.10.3390/s21217405 ↗
18. Fan, L., and Zou, J. (2023). A Novel Road Crack Detection Technology Based on Deep Dictionary Learning and Encoding Networks. Appl. Sci., 13.10.3390/app132212299 ↗
19. Hadinata, P.N., Simanta, D., Eddy, L., and Nagai, K. (2023). Multiclass segmentation of concrete surface damages using u-net and deeplabv3+. Appl. Sci., 13.10.3390/app13042398 ↗
20. Using attention for improving defect detection in existing RC bridges10.1109/ACCESS.2025.3532832 ↗
21. Improving Crack Detection Precision of Concrete Structures Using U-Net Architecture and Novel DBCE Loss Function10.1109/ACCESS.2025.3534803 ↗
22. Su, H., Wang, X., Han, T., Wang, Z., Zhao, Z., and Zhang, P. (2022). Research on a U-Net bridge crack identification and feature-calculation methods based on a CBAM attention mechanism. Buildings, 12.10.3390/buildings12101561 ↗
23. Fan, X., Yan, C., Fan, J., and Wang, N. (2022). Improved U-net remote sensing classification algorithm fusing attention and multiscale features. Remote Sens., 14.10.3390/rs14153591 ↗
24. U-net: Convolutional networks for biomedical image segmentation
25. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
26. Performance analysis of U-Net with hybrid loss for foreground detection10.1007/s00530-022-01014-5 ↗
27. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 21–26). Focal loss for dense object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/ICCV.2017.324 ↗
28. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15–20). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00075 ↗
29. MLcps: Machine learning cumulative performance score for classification problems