journal article·2022-09-09Open access

A Lightweight Residual Model for Corrosion Segmentation with Local Contextual Information

Jingxu Huang, Qiong Liu, Lang Xiang, Guangrui Li, Yiqing Zhang, Wenbai Chen

Applied Sciences· Volume 12· Issue 18

Abstract

Metal corrosion in high-risk areas, such as high-altitude cables and chemical factories, is very complex and inaccessible to people, which can be a hazard and compromise people’s safety. Embedding deep learning models into edge computing devices is urgently needed to conduct corrosion inspections. However, the parameters of current state-of-the-art models are too large to meet the computation and storage requirements of mobile devices, while lightweight models perform poorly in complex corrosion environments. To address these issues, a lightweight residual deep-learning model based on an encoder–decoder structure is proposed in this paper. We designed small and large kernels to extract local detailed information and capture distant dependencies at all stages of the encoder. A sequential operation consisting of a channel split, depthwise separable convolution, and channel shuffling were implemented to reduce the size of the model. We proposed a simple, efficient decoder structure by fusing multi-scale features to augment feature representation. In extensive experiments, our proposed model, with only 2.41 MB of parameters, demonstrated superior performance over state-of-the-art segmentation methods: 75.64% mean intersection over union (IoU), 86.07% mean pixel accuracy and a 0.838 F1-score. Moreover, a larger version was designed by increasing the number of output channels, and model accuracy improved further: 79.06% mean IoU, 88.07% mean pixel accuracy, and 0.891 F1-score. The size of the model remained competitive at 8.25 MB. Comparison work with other networks and visualized results were used for validation and to determine the accuracy of metal corrosion surface segmentation with limited resources.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Automation, Beijing Information Science and Technology University (BISTU), Beijing 100192, China

Funding

Beijing Natural Science Foundation · Qin Xin Talents Cultivation Program of Beijing Information Science and Technology University

References (48)

Show source-provided references
1. Global impact of corrosion: Occurrence, cost and mitigation
2. Deep learning in mobile and wireless networking: A survey10.1109/COMST.2019.2904897 ↗
3. Survey on industrial defect detection with deep learning10.1360/SSI-2021-0336 ↗
4. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
5. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.
6. Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8–14). Shufflenet v2: Practical guidelines for efficient cnn architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
7. Takos, G. (2020). A survey on deep learning methods for semantic image segmentation in real-time. arXiv.
8. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
9. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15–20). Dual attention network for scene segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00326 ↗
10. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
11. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
12. Classification of acoustic emission signals using wavelets and Random Forests: Application to localized corrosion10.1016/j.ymssp.2015.09.025 ↗
13. Image processing-based pitting corrosion detection using metaheuristic optimized multilevel image thresholding and machine-learning approaches10.1155/2020/6765274 ↗
14. Zou, Z., Ma, L., Fan, Q., Gan, X., and Qiao, L. (2017, January 6–10). Feature recognition of metal salt spray corrosion based on color spaces statistics analysis. Proceedings of the SPIE Optical Engineering + Applications, San Diego, CA, USA.10.1117/12.2273851 ↗
15. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection10.1177/1475921717737051 ↗
16. Ortiz, A., Bonnin-Pascual, F., Garcia-Fidalgo, E., and Company-Corcoles, J.P. (2016). Vision-based corrosion detection assisted by a micro-aerial vehicle in a vessel inspection application. Sensors, 16.10.3390/s16122118 ↗
17. A channel attention based deep neural network for automatic metallic corrosion detection10.1016/j.jobe.2021.103046 ↗
18. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
19. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
20. Xu, X., Wang, Y., Wu, J., and Wang, Y. (2020, January 16–18). Intelligent corrosion detection and rating based on faster region-based convolutional neural network. Proceedings of the 2020 Global Reliability and Prognostics and Health Management (PHM-Shanghai), Shanghai, China.10.1109/PHM-Shanghai49105.2020.9281005 ↗
21. Inspection of surface defects on stay cables using a robot and transfer learning10.1016/j.autcon.2020.103382 ↗
22. Fondevik, S.K., Stahl, A., Transeth, A.A., and Knudsen, O. (2020, January 9–11). Image Segmentation of Corrosion Damages in Industrial Inspections. Proceedings of the 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), Baltimore, MD, USA.10.1109/ICTAI50040.2020.00125 ↗
23. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
24. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Washington, DC, USA.10.1109/ICCV.2015.169 ↗
25. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
26. Yang, M., Yu, K., Zhang, C., Li, Z., and Yang, K. (2018, January 18–23). Denseaspp for semantic segmentation in street scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00388 ↗
27. Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). Enet: A deep neural network architecture for real-time semantic segmentation. arXiv.
28. Zhao, H., Qi, X., Shen, X., Shi, J., and Jia, J. (2018, January 8–14). Icnet for real-time semantic segmentation on high-resolution images. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01219-9_25 ↗
29. Mehta, S., Rastegari, M., Caspi, A., Shapiro, L., and Hajishirzi, H. (2018, January 8–14). Espnet: Efficient spatial pyramid of dilated convolutions for semantic segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01249-6_34 ↗
30. Chaurasia, A., and Culurciello, E. (2017, January 10–13). Linknet: Exploiting encoder representations for efficient semantic segmentation. Proceedings of the 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.10.1109/VCIP.2017.8305148 ↗
31. Erfnet: Efficient residual factorized convnet for real-time semantic segmentation10.1109/TITS.2017.2750080 ↗
32. Cgnet: A light-weight context guided network for semantic segmentation10.1109/TIP.2020.3042065 ↗
33. Han, W., Zhang, Z., Zhang, Y., Yu, J., Chiu, C.C., Qin, J., Gulati, A., Pang, R., and Wu, Y. (2020). Contextnet: Improving convolutional neural networks for automatic speech recognition with global context. arXiv.10.21437/Interspeech.2020-2059 ↗
34. Lo, S.Y., Hang, H.M., Chan, S.W., and Lin, J.J. (2019, January 16–18). Efficient dense modules of asymmetric convolution for real-time semantic segmentation. Proceedings of the ACM Multimedia Asia, Beijing, China.10.1145/3338533.3366558 ↗
35. Ding, X., Zhang, X., Han, J., and Ding, G. (2022, January 19–20). Scaling up your kernels to 31 × 31: Revisiting large kernel design in cnns. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01166 ↗
36. Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., and Torr, P.H. (2015, January 7–13). Conditional random fields as recurrent neural networks. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.179 ↗
37. Li, X., Zhong, Z., Wu, J., Yang, Y., Lin, Z., and Liu, H. (2019, January 27–28). Expectation-maximization attention networks for semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00926 ↗
38. Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., and Liu, W. (2019, January 27–28). Ccnet: Criss-cross attention for semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00069 ↗
39. Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 20–25). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00681 ↗
40. Cao, Y., Xu, J., Lin, S., Wei, F., and Hu, H. (2019, January 27–28). Gcnet: Non-local networks meet squeeze-excitation networks and beyond. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Korea.10.1109/ICCVW.2019.00246 ↗
41. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
42. SegFormer: Simple and efficient design for semantic segmentation with transformers
43. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
44. Segnet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
45. Bianchi, E., and Hebdon, M. (2021). Corrosion Condition State Semantic Segmentation Dataset, University Libraries, Virginia Tech.
46. Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25–28). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
47. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
48. Li, G., Yun, I., Kim, J., and Kim, J. (2019). Dabnet: Depth-wise asymmetric bottleneck for real-time semantic segmentation. arXiv.