journal article·2026-06

A comprehensive survey on multimodal computer vision (CV)-assisted corrosion assessment and corrosion prediction

Xinjie Yao, Yuheng Wu, Guangsheng Xie, DengYu Zhao, Da-Hai Xia

Publisher page

Abstract

Corrosion assessment and lifespan prediction, as core technologies in the lifecycle management of industrial metallic equipment, play an irreplaceable role in ensuring operational safety, optimising maintenance strategies and advancing industrial sustainability. With the rise of the fourth scientific paradigm of data-driven approaches, significant challenges have emerged to the third scientific paradigm of mathematical model-driven methods in the field of metal corrosion and protection. Corrosion image-based evaluation stands as one of the most intuitive methods among existing techniques. However, traditional image processing approaches for material surface corrosion suffer from limitations such as high dependency on image quality, inability to detect early-stage corrosion and restricted focus on surface-level information. These challenges have catalysed the emergence of the fifth paradigm, AI for Science (AI4S), in this domain. This review innovatively proposes a multimodal computer vision (CV)-assisted intelligent corrosion assessment framework. By systematically analysing advancements in CV for core tasks – including decoupling corrosion morphology features, cross-modal damage correlation modelling and corrosion dynamics evolution prediction – this work establishes a tripartite intelligent corrosion analysis framework integrating ‘multi-source data perception, feature synergy interpretation and mechanism-driven prediction’. It explores how CV enhances corrosion detection accuracy and lifespan prediction reliability through applications in corrosion classification, detection, segmentation, prediction and mechanistic analysis. The proposed multimodal fusion technology, coupled with deep learning-based intelligent corrosion type recognition and lifespan prediction models, represents critical future directions. These advancements hold significant potential for advancing intelligent corrosion monitoring and reducing industrial maintenance costs.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Structural Integrity and Reliability Analysis · Corrosion Behavior and Inhibition · Hydrogen embrittlement and corrosion behaviors in metals

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Kunming University of Science and Technology

Tianjin University

West Yunnan University of Applied Sciences

References (100+)

Show source-provided references
1. Koch G, Varney J, Thompson N, et al. International measures of prevention, application, and economics of corrosion technologies study. NACE Int 2016; 216: 2–3.
2. 10.1038/s41529-017-0005-210.1038/s41529-017-0005-2 ↗
3. Shasha W, Shuaijie M, Kun C, et al. Application Status of machine learning in field of natural environment corrosion assessment and prediction. J Chinese Soc Corros Prot 2022; 43: 441–451.
4. 10.1016/j.jmst.2020.04.03310.1016/j.jmst.2020.04.033 ↗
5. 10.1080/1478422X.2018.143273810.1080/1478422X.2018.1432738 ↗
6. Zhang X, Zhiming GAO, Wenbin HU, et al. Correlation between corrosion behavior and image information of Q235 steel beneath thin electrolyte film. J Chin Soc Corros Prot 2017; 37: 444–450.
7. Runxi S, Shizhe S, In-situ image grab and analysis for pitting process of 304 stainless steel. Acta Metall Sinica, 1998; 34: 966–970.
8. 10.1134/S102319351813045110.1134/S1023193518130451 ↗
9. 10.1016/j.corsci.2017.02.01510.1016/j.corsci.2017.02.015 ↗
10. 10.1108/ACMM-04-2019-210710.1108/ACMM-04-2019-2107 ↗
11. 10.1016/S0921-5093(04)00917-710.1016/S0921-5093(04)00917-7 ↗
12. 10.1016/j.msea.2007.05.00510.1016/j.msea.2007.05.005 ↗
13. 10.1016/j.apsusc.2008.04.08810.1016/j.apsusc.2008.04.088 ↗
14. Wang SY Song SZ. Corrosion morphology diagnosing system of metallic materials in seawater based on fractal. 2004.
15. Han XB, Gao ZM, Dang LH, et al. Wavelet packet analysis of early corrosion image of Q235 steel in simulated atmospheric environment. J Chin Corros Prot 2013; 33: 211–215.
16. Tol L, Song S, Jin W. Detection method based on color characteristic for coating aging deterioration. CIESC J 2009; 60: 415.
17. 10.1016/j.corsci.2020.10868510.1016/j.corsci.2020.108685 ↗
18. 10.1016/j.corsci.2024.11207710.1016/j.corsci.2024.112077 ↗
19. 10.1109/JSEN.2024.342847210.1109/JSEN.2024.3428472 ↗
20. 10.1016/j.cemconres.2020.10608110.1016/j.cemconres.2020.106081 ↗
21. 10.1016/j.eswa.2021.11646110.1016/j.eswa.2021.116461 ↗
22. 10.5006/1.358493810.5006/1.3584938 ↗
23. Dosovitskiy A Beyer L Kolesnikov A et al. An image is worth 16 × 16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 2020.
24. 10.1016/j.corsci.2025.11270110.1016/j.corsci.2025.112701 ↗
25. 10.1016/S1003-6326(21)65727-810.1016/S1003-6326(21)65727-8 ↗
26. 10.1016/S0010-938X(03)00140-910.1016/S0010-938X(03)00140-9 ↗
27. 10.1016/j.corsci.2022.11075510.1016/j.corsci.2022.110755 ↗
28. 10.1016/j.corsci.2022.11058910.1016/j.corsci.2022.110589 ↗
29. 10.1016/j.corsci.2013.10.02710.1016/j.corsci.2013.10.027 ↗
30. 10.1016/j.inoche.2025.11420610.1016/j.inoche.2025.114206 ↗
31. 10.1016/j.corsci.2015.12.02310.1016/j.corsci.2015.12.023 ↗
32. 10.1016/j.jmatprotec.2024.11867710.1016/j.jmatprotec.2024.118677 ↗
33. 10.1364/AO.58.00687310.1364/AO.58.006873 ↗
34. 10.1016/j.corsci.2017.09.00110.1016/j.corsci.2017.09.001 ↗
35. 10.1016/j.corsci.2008.03.02010.1016/j.corsci.2008.03.020 ↗
36. 10.1007/s11760-021-02126-710.1007/s11760-021-02126-7 ↗
37. Paetsch O, Baum D, Prohaska S, et al. 3D corrosion detection in time-dependent CT images of concrete. In Proceedings of the digital industrial radiology and computed tomography conference, Ghent. Belgium. 2015: p. 22–25.
38. 10.1038/s41529-022-00232-610.1038/s41529-022-00232-6 ↗
39. 10.1016/j.psep.2023.04.01010.1016/j.psep.2023.04.010 ↗
40. 10.3390/jmse811092410.3390/jmse8110924 ↗
41. 10.1016/j.net.2020.07.02010.1016/j.net.2020.07.020 ↗
42. 10.3390/s1812437910.3390/s18124379 ↗
43. 10.1016/j.engfailanal.2023.10773510.1016/j.engfailanal.2023.107735 ↗
44. 10.1016/j.jobe.2023.10701410.1016/j.jobe.2023.107014 ↗
45. Munawar HS. Image and video processing for defect detection in key infrastructure. Machine vision inspection systems: image processing, concepts. Methodol Appl 2020; 1: 159–177.
46. 10.1016/j.engfailanal.2014.04.01610.1016/j.engfailanal.2014.04.016 ↗
47. 10.1080/20464177.2016.124763510.1080/20464177.2016.1247635 ↗
48. Oki M, Adediran AA, Anawe PA. Corrosion monitoring in the oil pipeline industry. J Multidiscip Eng Sci Technol (JMEST) 2013; 2: 229–302.
49. 10.1109/5.72679110.1109/5.726791 ↗
50. 10.1145/306538610.1145/3065386 ↗
51. Simonyan K Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 2014.
52. Szegedy C, Liu W, Jia Y, et al. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp.1–9.
53. He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
54. Howard AG Zhu M Chen B. Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 2017.
55. Zhang X, Zhou X, Lin M, et al. Shufflenet: an extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 6848–6856.
56. Tan M, Le Q. Efficientnet: rethinking model scaling for convolutional neural networks. In International conference on machine learning. PMLR, 2019, pp. 6105–6114.
57. 10.31857/S013030822312008410.31857/S0130308223120084 ↗
58. Zhao Z, Bakar EBA, Razak NBA, et al. Corrosion image classification method based on EfficientNetV2. Heliyon 2024; 10: 1–22.
59. Liu Z, Lin Y, Cao Y, et al. Swin transformer: hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 10012–10022.
60. Chee ALT, Saaveethya S, Lim KH, et al. Steel surface defect classification using MobileViT[. In 2024 10th international conference on smart computing and communication (ICSCC). IEEE, 2024, pp. 165–170.
61. Raj MM, Jothi JAAI, Kumar VS. Automated pitting corrosion detection of metallic glass using deep learning. In 2024 international conference on innovation and novelty in engineering and technology (INNOVA). IEEE, 2024, 1, pp. 1–6.
62. 10.1016/j.asoc.2024.11200810.1016/j.asoc.2024.112008 ↗
63. 10.1016/j.ndteint.2019.10213410.1016/j.ndteint.2019.102134 ↗
64. 10.1016/j.chaos.2020.10980710.1016/j.chaos.2020.109807 ↗
65. 10.1016/j.autcon.2011.12.00110.1016/j.autcon.2011.12.001 ↗
66. 10.1023/A:102262741141110.1023/A:1022627411411 ↗
67. Dalal N, Triggs B. Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05). IEEE, 2005; 1, pp. 886–893.
68. 10.1007/s00521-017-3237-810.1007/s00521-017-3237-8 ↗
69. 10.1080/10789669.2010.1039090610.1080/10789669.2010.10390906 ↗
70. Sugumar R, Suganya D. A multi-spectral image-based high-level classification based on a modified SVM with enhanced PCA and hybrid metaheuristic algorithm. Remote Sens Appl: Soc Environ 2023; 31: 100984.
71. 10.1016/j.procs.2020.03.30910.1016/j.procs.2020.03.309 ↗
72. 10.1023/A:102264320487710.1023/A:1022643204877 ↗
73. Quinlan JR. C4.5: programs for machine learning. Burlington, MA: Morgan Kaufmann Publishers, 2014.
74. 10.1023/A:101093340432410.1023/A:1010933404324 ↗
75. 10.1145/2939672.293978510.1145/2939672.2939785 ↗
76. Ke G, Meng Q, Finley T. Lightgbm: a highly efficient gradient boosting decision tree. Adv Neural Inf Process Syst 2017; 30: 1–9.
77. Kiran BR, Serra J. Cost-complexity pruning of random forests. In Mathematical morphology and its applications to signal and image processing: 13th international symposium, ISMM 2017, Fontainebleau, France, May 15–17, 2017, Proceedings 13. Springer International Publishing, 2017, pp. 222–232.
78. 10.1198/01621450175316839810.1198/016214501753168398 ↗
79. 10.1093/nsr/nwy10810.1093/nsr/nwy108 ↗
80. 10.1016/j.neunet.2019.09.01010.1016/j.neunet.2019.09.010 ↗
81. 10.1109/JSTARS.2025.354171810.1109/JSTARS.2025.3541718 ↗
82. 10.1016/j.psep.2024.05.01410.1016/j.psep.2024.05.014 ↗
83. 10.1007/s12613-023-2661-210.1007/s12613-023-2661-2 ↗
84. Chen M, Radford A, Child R, et al. Generative pretraining from pixels. In International conference on machine learning. PMLR, 2020, pp. 1691–1703.
85. 10.1016/j.ymssp.2023.11091910.1016/j.ymssp.2023.110919 ↗
86. 10.1016/j.engappai.2025.11132010.1016/j.engappai.2025.111320 ↗
87. Girshick R, Donahue J, Darrell T. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 580–587.
88. 10.3390/infrastructures901000310.3390/infrastructures9010003 ↗
89. Ren S, He K, Girshick R, et al. Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst 2015; 28: 1137–1149.
90. He K, Gkioxari G. Dollár P. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision, 2017, pp. 2961–2969.
91. 10.3390/buildings1202015610.3390/buildings12020156 ↗
92. Cai Z, Vasconcelos N. Cascade r-cnn: delving into high quality object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 6154–6162.
93. 10.1111/mice.1226310.1111/mice.12263 ↗
94. 10.1016/j.ijnaoe.2024.10061710.1016/j.ijnaoe.2024.100617 ↗
95. 10.1007/978-3-030-58452-8_1310.1007/978-3-030-58452-8_13 ↗
96. Redmon J, Divvala S, Girshick R. You only look once: unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 779–788.
97. Redmon J, Farhadi A. YOLO9000, better, faster, stronger. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 7271–7271.
98. Redmon J Farhadi A. Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767 2018.
99. 10.1007/s12652-021-03580-410.1007/s12652-021-03580-4 ↗
100. Bochkovskiy A Wang CY Liao HYM. Yolov4: optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 2020.