Corrosion Detection and Grading Method for Hydraulic Metal Structures Based on an Improved YOLOv10 Sequential Architecture
Source abstract
Abstract
Herein, we present a method for detecting and determining the corrosion level of hydraulic metal structure surfaces through images while reducing the difficulty of dataset annotation. To achieve accurate detection of corrosion targets, the MobileViTv3 block is integrated into YOLOv10, resulting in the proposed YOLOv10-vit for corrosion target detection. Based on YOLOv10-vit, the YOLOv10-vit-cls classification network is introduced for corrosion level determination. This network leverages the pre-trained parameters of YOLOv10-vit to more quickly learn the features of different corrosion levels. To avoid subjective factors in the corrosion level annotation process and reduce annotation difficulty, a cascaded corrosion detection architecture combining YOLOv10-vit and YOLOv10-vit-cls is proposed. Finally, based on the proposed corrosion detection architecture, we achieve accurate corrosion detection and level determination for hydraulic metal structures.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Infrastructure Engineering, Dalian University of Technology, Dalian 116024, China
Funding
National Key R&D Program of China · Scientific Research Project of China Yangtze Power Co., Ltd.
References (47)
Show source-provided references
1. Niu, L.M., Yan, J., and Gao, D.S. (2020, January 4–5). Research on Corrosion and Defects of Hydraulic Metal Structures. Proceedings of the 6th International Conference on Environmental Science and Civil Engineering (ESCE), Nanchang, China.
2. Accurate Detection Method of Corrosion State of Steel Structure Bridge in Internet of Things Environment Based on Visual Image Characteristics10.1520/JTE20230083 ↗
3. Detection of corrosion on steel structures using automated image processing10.1016/j.dibe.2020.100022 ↗
4. Segmentation of rust defects on painted steel surfaces by intelligent image analysis10.1016/j.autcon.2020.103515 ↗
5. May, Z., Alam, M.K., Nayan, N.A., Rahman, N.A.A., and Mahmud, M.S. (2021). Acoustic emission corrosion feature extraction and severity prediction using hybrid wavelet packet transform and linear support vector classifier. PLoS ONE, 16.10.1371/journal.pone.0261040 ↗
6. Detection of rust defects on steel bridge coatings via digital image recognition10.1016/j.autcon.2016.08.008 ↗
7. Support-vector-machine-based method for automated steel bridge rust assessment10.1016/j.autcon.2011.12.001 ↗
8. Ali, A., Jamaludin, S., Imran, M.M.H., Ayob, A.F.M., Ahmad, S., Akhbar, M.F.A., Suhrab, M.I.R., and Ramli, M.R. (2023). Computer Vision and Image Processing Approaches for Corrosion Detection. J. Mar. Sci. Eng., 11.10.3390/jmse11101954 ↗
9. Imran, M.M.H., Jamaludin, S., Ayob, A.F.M., Ali, A., Ahmad, S., Akhbar, M.F.A., Suhrab, M.I.R., Zainal, N., Norzeli, S.M., and Mohamed, S.B. (2023). Application of Artificial Intelligence in Marine Corrosion Prediction and Detection. J. Mar. Sci. Eng., 11.10.3390/jmse11020256 ↗
10. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection10.1177/1475921717737051 ↗
11. Ma, Y.C., Yang, Y., Yao, Y., Li, S.Y., and Zhao, X.F. (2018, January 5–6). Image-based corrosion recognition for ship steel structures. Proceedings of the Conference on Smart Structures and NDE for Industry 4.0, Denver, CO, USA.10.1117/12.2296540 ↗
12. Artificial intelligence-based hull structural plate corrosion damage detection and recognition using convolutional neural network10.1016/j.apor.2019.05.008 ↗
13. Holm, E., Transeth, A.A., Knudsen, O., and Stahl, A. (2019, January 16–18). Classification of corrosion and coating damages on bridge constructions from images using convolutional neural networks. Proceedings of the Twelfth International Conference on Machine Vision (ICMV 2019), Amsterdam, The Netherlands.10.1117/12.2557380 ↗
14. Automated detection of corrosion in used nuclear fuel dry storage canisters using residual neural networks10.1016/j.net.2020.07.020 ↗
15. Intelligent analysis of corrosion characteristics of steel pipe piles of offshore construction wharfs based on computer vision10.1016/j.heliyon.2024.e24142 ↗
16. Yu, Q.F., Han, Y.D., Lin, W.G., and Gao, X.J. (2024). Detection and Analysis of Corrosion on Coated Metal Surfaces Using Enhanced YOLO v5 Algorithm for Anti-Corrosion Performance Evaluation. J. Mar. Sci. Eng., 12.10.3390/jmse12071090 ↗
17. Optimized deep learning for steel bridge bolt corrosion detection and classification10.1016/j.jcsr.2024.108570 ↗
18. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
19. Automatic detection of carbon steel corrosion degree based on image identification10.1016/j.commatsci.2023.112717 ↗
20. Recognition of steel bridge corrosion considering the effect of training dataset quality
21. Automatic pixel-level detection and measurement of corrosion-related damages in dim steel box girders using Fusion-Attention-U-net10.1007/s13349-022-00631-y ↗
22. Simultaneous Precise Localization and Classification of metal rust defects for robotic-driven maintenance and prefabrication using residual attention U-Net10.1016/j.autcon.2022.104182 ↗
23. Katsamenis, I., Protopapadakis, E., Doulamis, A., Doulamis, N., and Voulodimos, A. (2020, January 5–7). Pixel-level corrosion detection on metal constructions by fusion of deep learning semantic and contour segmentation. Proceedings of the International Symposium on Visual Computing, San Diego, CA, USA.10.1007/978-3-030-64556-4_13 ↗
24. An end-to-end framework for shipping container corrosion defect inspection
25. CorrDetector: A framework for structural corrosion detection from drone images using ensemble deep learning10.1016/j.eswa.2021.116461 ↗
26. Deep learning corrosion detection with confidence10.1038/s41529-022-00232-6 ↗
27. Attention-Enhanced Co-Interactive Fusion Network (AECIF-Net) for automated structural condition assessment in visual inspection10.1016/j.autcon.2024.105292 ↗
28. MaDnet: Multi-task semantic segmentation of multiple types of structural materials and damage in images of civil infrastructure10.1007/s13349-020-00409-0 ↗
29. Image-based concrete crack detection in tunnels using deep fully convolutional networks10.1016/j.conbuildmat.2019.117367 ↗
30. Protopapadakis, E., Katsamenis, I., and Doulamis, A. (July, January 30). Multi-label deep learning models for continuous monitoring of road infrastructures. Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Greece.
31. Xu, H., Su, X., Wang, Y., Cai, H., Cui, K., and Chen, X. (2019). Automatic bridge crack detection using a convolutional neural network. Appl. Sci., 9.10.3390/app9142867 ↗
32. Chen, D., Huang, B., and Kang, F. (2023). A review of detection technologies for underwater cracks on concrete dam surfaces. Appl. Sci., 13.10.3390/app13063564 ↗
33. Enhancement of underwater dam crack images using multi-feature fusion10.1016/j.autcon.2024.105727 ↗
34. Structural health monitoring of railway tracks using IoT-based multi-robot system10.1007/s00521-020-05366-9 ↗
35. Underwater dam crack image generation based on unsupervised image-to-image translation10.1016/j.autcon.2024.105430 ↗
36. Displacement prediction model for high arch dams using long short-term memory based encoder-decoder with dual-stage attention considering measured dam temperature10.1016/j.engstruct.2023.115686 ↗
37. A YOLO-NL object detector for real-time detection10.1016/j.eswa.2023.122256 ↗
38. Advanced drone-based weed detection using feature-enriched deep learning approach10.1016/j.knosys.2024.112655 ↗
39. MOD-YOLO: Rethinking the YOLO architecture at the level of feature information and applying it to crack detection10.1016/j.eswa.2023.121346 ↗
40. Wang, A., Chen, H., Liu, L., Chen, K., Lin, Z., Han, J., and Ding, G. (2024). Yolov10: Real-time end-to-end object detection. arXiv.
41. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3–7). AN IMAGE IS WORTH 16X16 WORDS: TRANSFORMERS FOR IMAGE RECOGNITION AT SCALE. Proceedings of the ICLR 2021-9th International Conference on Learning Representations, Virtual Event, Austria.
42. Mehta, S., and Rastegari, M. (2022, January 25–29). MOBILEVIT: LIGHT-WEIGHT, GENERAL-PURPOSE, AND MOBILE-FRIENDLY VISION TRANSFORMER. Proceedings of the ICLR 2022-10th International Conference on Learning Representations, Virtual Event.
43. Mehta, S., and Rastegari, M. (2022). Separable self-attention for mobile vision transformers. arXiv.
44. Wadekar, S.N., and Chaurasia, A. (2022). Mobilevitv3: Mobile-friendly vision transformer with simple and effective fusion of local, global and input features. arXiv.
45. Chen, Y., Dai, X., Chen, D., Liu, M., Dong, X., Yuan, L., and Liu, Z. (2022, January 18–24). Mobile-former: Bridging mobilenet and transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00520 ↗
46. Coatnet: Marrying convolution and attention for all data sizes
47. (2024, December 21). Tzutalin. LabelImg. Git Code. Available online: https://github.com/tzutalin/labelImg.