journal article·2024-10-29Open access

Efficient Metal Corrosion Area Detection Model Combining Convolution and Transformer

Jiurong Guo, Li Wang, Liang Hua

Applied Sciences· Volume 14· Issue 21

Abstract

In the context of rapid industrialization, efficiently detecting metal corrosion areas has become a critical task in preventing material damage. Unlike conventional semantic segmentation targets, metal corrosion characteristics vary significantly in color, texture, and size. Traditional image segmentation methods need improvement in scenarios involving occlusions, shadows, and defects. This paper proposes a convolution and sequence encoding combined network, MCD-Net, for metal corrosion area segmentation. First, a visual Transformer sequence encoder is introduced into the convolutional encoder–decoder network to enhance global information processing capabilities and establish long-range feature dependencies. A feature fusion method based on an attention module is proposed to enhance the model’s ability to recognize corrosion boundaries, thereby enhancing segmentation accuracy and model robustness. Finally, in the model’s decoding stage, a score-based multi-scale feature enhancement method is employed to emphasize significant features in the corrosion areas. Experimental results indicate that this method attained an F1 score of 84.53% on a public corrosion dataset, demonstrating the model’s deeper understanding and reasoning capabilities for shadow and defect features, as well as excellent noise resistance performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Non-Destructive Testing Techniques · Infrastructure Maintenance and Monitoring

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electrical Engineering and Automation, Nantong University, Nantong 226001, China

Funding

National Natural Science Foundation of China under Grants

References (31)

Show source-provided references
1. The impact of corrosion on society10.1007/s11661-011-0703-2 ↗
2. Koch, G. (2017). Cost of corrosion. Trends in Oil and Gas Corrosion Research and Technologies, Woodhead Publishing.10.1016/B978-0-08-101105-8.00001-2 ↗
3. Sensors in advancing the capabilities of corrosion detection: A review10.1016/j.sna.2021.113086 ↗
4. Nanosensors for monitoring early stages of metallic corrosion10.1021/acsanm.8b02045 ↗
5. High-frequency ultrasonic methods for determining corrosion layer thickness of hollow metallic components10.1016/j.ultras.2018.05.006 ↗
6. A survey of computer vision based corrosion detection approaches
7. Segmentation of rust defects on painted steel surfaces by intelligent image analysis10.1016/j.autcon.2020.103515 ↗
8. Detection of corrosion on steel structures using automated image processing10.1016/j.dibe.2020.100022 ↗
9. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection10.1177/1475921717737051 ↗
10. Deep learning and machine vision-based inspection of rail surface defects
11. Lemos, R., Cabral, R., Ribeiro, D., Santos, R., Alves, V., and Dias, A. (2023). Automatic detection of corrosion in large-scale industrial buildings based on artificial intelligence and unmanned aerial vehicles. Appl. Sci., 13.10.3390/app13031386 ↗
12. Han, G., Lv, S., Tao, Z., Sun, X., and Du, B. (2024). Evaluation of Bolt Corrosion Degree Based on Non-Destructive Testing and Neural Network. Appl. Sci., 14.10.3390/app14125069 ↗
13. Simultaneous Precise Localization and Classification of metal rust defects for robotic-driven maintenance and prefabrication using residual attention U-Net10.1016/j.autcon.2022.104182 ↗
14. Automatic pixel-level detection and measurement of corrosion-related damages in dim steel box girders using Fusion-Attention-U-net10.1007/s13349-022-00631-y ↗
15. A survey on vision transformer10.1109/TPAMI.2022.3152247 ↗
16. Strudel, R., Garcia, R., Laptev, I., and Schmid, C. (2021, January 19–21). Segmenter: Transformer for semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Zhuhai, China.10.1109/ICCV48922.2021.00717 ↗
17. Detecting affect states using VGG16, ResNet50 and SE-ResNet50 networks10.1007/s42979-020-0114-9 ↗
18. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
19. A survey of visual transformers10.1109/TNNLS.2022.3227717 ↗
20. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
21. Yang, L., Zhang, R.-Y., Li, L., and Xie, X. (2021, January 18–24). Simam: A simple, parameter-free attention module for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Virtual.
22. Zou, Y., Zhang, G., and Fan, Y. (2024). Research on the Detection of Steel Plate Defects Based on SimAM and Twin-NMF Transfer. Mathematics, 12.10.3390/math12172782 ↗
23. Bianchi, E., and Hebdon, M. (2021). Corrosion Condition State Semantic Segmentation Dataset, University Libraries, Virginia Tech.
24. Zhang, H., Zu, K., Lu, J., Zou, Y., and Meng, D. (2022, January 4–8). EPSANet: An efficient pyramid squeeze attention block on convolutional neural network. Proceedings of the Asian Conference on Computer Vision, Macau, China.10.1007/978-3-031-26313-2_33 ↗
25. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
26. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.74 ↗
27. Sun, K., Xiao, B., Liu, D., and Wang, J. (2019, January 15–20). Deep high-resolution representation learning for human pose estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00584 ↗
28. Chen, L.-C. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv.10.1007/978-3-030-01234-2_49 ↗
29. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
30. SegFormer: Simple and efficient design for semantic segmentation with transformers
31. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗