A weld defect segmentation framework based on visual self-supervised learning
Source abstract
Abstract
When a ray image is selected as the target object, accurately segmenting the internal defects of a weld can yield the size and contour information of the defects and provide a basis for evaluating the welding quality. Currently, the mainstream defect segmentation strategies are image semantic segmentation methods based on standard supervised learning. As data-intensive paradigms, such methods are usually supervised by pixel-level dense labels, which not only require the labellers to have expertise in radiographic inspection and experience in defect assessment but also involve a very time-consuming labelling process. Despite the large amount of defect data accumulated in the current industry, the amount of available labelled data is small. To solve this problem, an automatic weld defect segmentation framework based on self-supervised learning theory is proposed. Specifically, a semiautomatic defect data extraction engine was constructed to form a large defect dataset that can be used for self-supervised pretraining, and an object-level masking strategy and a multihead decoding segmenter were designed. Experiments show that the proposed method can effectively utilise unlabelled data and improve the performance of the defect segmentation model. The defect data used in this paper can be obtained at https://github.com/longteng-coder/Wdsf-ssl.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Welding Techniques and Residual Stresses · Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Xi’an Jiaotong University
Non destructive Testing and Evaluation Center, CNPC Tubular Goods Research Institute
China Classification Society Quality Certification Co., Ltd
Funding
National Natural Science Foundation of China · Key R&D Program·of·Ningxia·Hui Autonomous Region
References (43)
Show source-provided references
1. 10.1109/tii.2023.324159510.1109/tii.2023.3241595 ↗
2. 10.1109/tmech.2023.332226810.1109/tmech.2023.3322268 ↗
3. 10.1016/j.compind.2019.07.00510.1016/j.compind.2019.07.005 ↗
4. 10.1088/1742-6596/1237/2/02212210.1088/1742-6596/1237/2/022122 ↗
5. 10.1016/j.ndteint.2017.11.00610.1016/j.ndteint.2017.11.006 ↗
6. Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proc. IEEE Conf. Comput. Vision Pattern Recognit, Boston Massachusetts: IEEE; 2015. p. 3431–3440.
7. Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation. In: Medical image computing assisted intervention– MICCAICham; 2015. p. 234–241.
8. Chen LC, Papandreou G, Kokkinos I, et al. Semantic image segmentation with deep convolutional nets and fully connected CRFs, in: 3rd Int. In: Conf learn representations, ICLR. 2015:7–9.
9. Chen LC, Zhu Y, Papandreou G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Computer Vision – ECCV 2018; Cham; 2018. p. 833–851.10.1007/978-3-030-01234-2_49 ↗
10. 10.1109/tie.2020.304706010.1109/tie.2020.3047060 ↗
11. 10.1016/j.ndteint.2023.10293410.1016/j.ndteint.2023.102934 ↗
12. 10.1080/10589759.2025.249173910.1080/10589759.2025.2491739 ↗
13. 10.1109/access.2020.300545010.1109/access.2020.3005450 ↗
14. 10.1016/j.ndteint.2022.10278410.1016/j.ndteint.2022.102784 ↗
15. Wu Z, Xiong Y, Yu SX, et al. Unsupervised feature learning via non-parametric instance discrimination. In: 2018 IEEE/CVF Conference on Computer Vision Pattern Recognit; 2018. p. 3733–3742.10.1109/CVPR.2018.00393 ↗
16. He K, Fan H, Wu Y, et al. Momentum contrast for unsupervised visual representation learning. In: 2020 IEEE/CVF Conference on Compute Vision Pattern Recognit; Seattle. CVPR; 2020. p. 9726–9735.
17. Chen T, Kornblith S, Norouzi M, et al. A simple framework for contrastive learning of visual representations. In: Proceedings of the 37th International Conference on Machine Learning, Virtual, Online; 2020.
18. 10.1080/10589759.2025.245006310.1080/10589759.2025.2450063 ↗
19. Bao H Dong L Piao S et al. Beit: bERT pre-training of image transformers. 10th International Conference on Learning Representations. ICLR; 2022.
20. He K, Chen X, Xie S, et al. Masked autoencoders are scalable vision learners. In: Proc. IEEE/CVF Conf. Comput. Vision Pattern Recognit, New Orleans, LA, United states; 2022. p. 16000–16009.
21. Caron M, Touvron H, Misra I, et al. Emerging properties in self-supervised vision transformers. In: 18th IEEE/CVF International Conference on Computer Vision. Canada; 2021. p. 9650–9660.
22. Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. In: 31st Annual Conference on Neural Information Processing Systems. Long Beach, CA, United states. NIPS; 2017. p. 5998–6008.
23. 10.1007/s10921-015-0315-710.1007/s10921-015-0315-7 ↗
24. 10.53375/ijecer.2023.32010.53375/ijecer.2023.320 ↗
25. 10.1007/s10921-025-01186-w10.1007/s10921-025-01186-w ↗
26. 10.1109/TII.2025.356849910.1109/TII.2025.3568499 ↗
27. 10.1109/TIM.2024.349387810.1109/TIM.2024.3493878 ↗
28. 10.1080/10589759.2025.249579910.1080/10589759.2025.2495799 ↗
29. 10.1109/TIM.2025.355185210.1109/TIM.2025.3551852 ↗
30. 10.1080/10589759.2025.254837410.1080/10589759.2025.2548374 ↗
31. 10.1016/j.knosys.2022.10833810.1016/j.knosys.2022.108338 ↗
32. Ultralytics. YOLOv8. 2023. Available https://github.com/ultralytics/ultralytics/tree/main/ultralytics/models/v8
33. Devlin J, Chang MW, Lee K, et al. Bert: pre-training of deep bidirectional transformers for language understanding. In: Proc. NAACL-HLT. Minneapolis, MN, United states; 2019.
34. Zheng S, Lu J, Zhao H, et al. Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR,USA: IEEE Computer Society; 2021.
35. 10.1145/306538610.1145/3065386 ↗
36. Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: 32nd International Conference on Machine Learning Lile, France. ICML; 2015.
37. 10.1007/s11263-014-0733-510.1007/s11263-014-0733-5 ↗
38. Loshchilov I, Hutter F. Decoupled weight decay regularization. In: 7th International Conference on Learning Representations. New Orleans, LA, United states. ICLR; 2019.
39. Loshchilov I, Hutter F. Sgdr: stochastic gradient descent with warm restarts. In: 5th International Conference on Learning Representations, Toulon, France. ICLR; 2017.
40. Hong Y Pan H Sun W et al. Deep dual-resolution networks for real-time and accurate semantic segmentation of road scenes. arXiv preprint arXiv:2101.06085.
41. Guo M-H, Lu C-Z, Hou Q, et al. SegNeXt: rethinking convolutional attention design for semantic segmentation. In: 36th Conference on Neural Information Processing Systems, NeurIPS,New Orleans, LA, United states. Neural information processing systems foundation; 2022.
42. Xie E, Wang W, Yu Z, et al. Segformer: simple and efficient design for semantic segmentation with transformers. Adv Neural Inf Process Syst. 2021;34:12077–12090.
43. Xu J, Xiong Z, Bhattacharyya SP. Pidnet: a real-time semantic segmentation network inspired by PID controllers. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR: Vancouver, BC, Canada. IEEE Computer Society; 2023.