journal article·2024-06-18Open access

A Deep Learning Image Corrosion Classification Method for Marine Vessels Using an Eigen Tree Hierarchy Module

Georgios Chliveros, Iason Tzanetatos, Stylianos V. Kontomaris

Coatings· Volume 14· Issue 6

Abstract

This paper involves the automation of a visual characterisation technique for corrosion in marine vessels, as it appears in the hull preventive coatings of marine vessels and their surfaces. We propose a module that maximizes the utilisation of features learned by a deep convolutional neural network to identify areas of corrosion and segment pixels in regions of inspection interest for corrosion detection. Our segmentation module is based on Eigen tree decomposition and information-based decision criteria in order to produce specific corroded spots—regions of interest. To assess performance and compare it with our method, we utilize several state-of-the-art deep learning architectures.The results indicate that our method achieves higher accuracy and precision while maintaining the significance score across the entire dataset. To the best of our knowledge, this is the first Eigen tree-based module in the literature in the context of trained neural network predictors for classifying corrosion in marine vessel images.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Structural Integrity and Reliability Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Engineering, Metropolitan College, Marousi Campus, 15125 Athens, Greece

Core Innovation Center, Core Innovation and Technology OE, 17343 Athens, Greece

References (34)

Show source-provided references
1. Cost of corrosion and corrosion maintenance strategies10.1515/CORRREV.2007.25.3-4.247 ↗
2. A critical review of machine learning algorithms in maritime, offshore, and oil & gas corrosion research: A comprehensive analysis of ANN and RF models10.1016/j.oceaneng.2024.116796 ↗
3. Corrosion uncertainty modelling for steel structures10.1016/S0143-974X(99)00010-3 ↗
4. Crack growth: Does microstructure play a role?10.1016/j.engfracmech.2017.11.023 ↗
5. Fatigue damage in polycrystals—Part 1: The numbers two and three10.1016/j.tafmec.2007.10.007 ↗
6. Fatigue damage in polycrystals—Part 2: Intrinsic scatter of fatigue life10.1016/j.tafmec.2007.10.001 ↗
7. International Maritime Organization (2023, May 12). International Convention for the Safety of Life at Sea. Available online: https://www.refworld.org/docid/46920bf32.html.
8. The exploration and annotation of large amounts of visual inspection data for protective coating systems on stationary marine steel structures10.1016/j.oceaneng.2023.114337 ↗
9. Zhang, J., Cho, Y., Kim, J., Malikov, A.K.u., Kim, Y.H., Yi, J.H., and Li, W. (2021). Non-destructive evaluation of coating thickness using water immersion ultrasonic testing. Coatings, 11.10.3390/coatings11111421 ↗
10. On the use of robots and vision technologies for the inspection of vessels: A survey on recent advances10.1016/j.oceaneng.2019.106420 ↗
11. Deep learning corrosion detection with confidence10.1038/s41529-022-00232-6 ↗
12. Ali, A.A.I.M., Jamaludin, S., Imran, M.M.H., Ayob, A.F.M., Ahmad, S.Z.A.S., Akhbar, M.F.A., Suhrab, M.I.R., and Ramli, M.R. (2023). Computer Vision and Image Processing Approaches for Corrosion Detection. J. Mar. Sci. Eng., 11.10.3390/jmse11101954 ↗
13. Alboul, L., and Chliveros, G. (2010, January 7–10). A system for reconstruction from point clouds in 3D: Simplification and mesh representation. Proceedings of the 11th International Conference on Control Automation Robotics & Vision, Singapore.10.1109/ICARCV.2010.5707901 ↗
14. Chen, M., Leibe, B., and Neumann, B. (2013). Robust Multi-hypothesis 3D Object Pose Tracking. Proceedings of the Lecture Notes in Computer Science, Vol. 7963: Computer Vision Systems, Springer.
15. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection10.1177/1475921717737051 ↗
16. Reviewing machine learning of corrosion prediction in a data-oriented perspective10.1038/s41529-022-00218-4 ↗
17. Emerging AI technologies for corrosion monitoring in oil and gas industry: A comprehensive review10.1016/j.engfailanal.2023.107735 ↗
18. CorrDetector: A framework for structural corrosion detection from drone images using ensemble deep learning10.1016/j.eswa.2021.116461 ↗
19. Damage Detection on Steel-Reinforced Concrete Produced by Corrosion via YOLOv3; A detailed guide
20. Brandoli, B., de Geus, A.R., Souza, J.R., Spadon, G., Soares, A., Rodrigues, J.F., Komorowski, J., and Matwin, S. (2021). Aircraft Fuselage Corrosion Detection Using Artificial Intelligence. Sensors, 21.10.3390/s21124026 ↗
21. Das, A., Ichi, E., and Dorafshan, S. (2023). Image-Based Corrosion Detection in Ancillary Structures. Infrastructures, 8.10.3390/infrastructures8040066 ↗
22. Automatic Identification of Corrosion in Marine Vessels Using Decision-Tree Imaging Hierarchies10.3390/eng4030118 ↗
23. A multi-task segmentation and classification network for remote ship hull inspection10.1016/j.oceaneng.2024.117608 ↗
24. Ortiz, A., Bonnin-Pascual, F., Garcia-Fidalgo, E., and Company-Corcoles, J. (2016). Vision-Based Corrosion Detection Assisted by a Micro-Aerial Vehicle in a Vessel Inspection Application. Sensors, 16.10.3390/s16122118 ↗
25. Nash, W., Drummond, T., and Birbilis, N. (2019, January 24–28). Deep Learning AI for corrosion detection. Proceedings of the NACE International CORROSION Conference Proceedings, NACE-2019-13267, Nashville, TN, USA.
26. Examination of the Potential Effect of Corrosion Current Density of Ship Hulls on the Sacrificial Anode Cathodic Protection10.17798/bitlisfen.1133653 ↗
27. Ship hull inspection: Survey10.1016/j.oceaneng.2023.116281 ↗
28. Color Quantization of Images10.1109/78.107417 ↗
29. Geometric Decision Tree10.1109/TSMCB.2011.2163392 ↗
30. Tree decomposition by eigenvectors10.1016/j.laa.2008.07.015 ↗
31. Deep High-Resolution Representation Learning for Visual Recognition10.1109/TPAMI.2020.2983686 ↗
32. Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24571-3 ↗
33. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA.10.1109/CVPR.2016.91 ↗
34. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023, January 1–6). Segment Anything. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France.10.1109/ICCV51070.2023.00371 ↗