journal article·2025-02-10Open access

Weld Pool Boundary Detection Based on the U-Net Algorithm and Weld Seam Tracking in Plasma Arc Welding

Jidong Lu, Satoshi Yamane, Weixi Wang, Ning Li, Siqi Wang, Yuxiong Xia

Applied Sciences· Volume 15· Issue 4

Abstract

Plasma arc welding can achieve high-quality welding joints in high-strength manufacturing fields, such as aviation and automotive, and improve production efficiency. It is important to observe the weld pool state in real-time in robot automatic welding. However, the electrodes of the plasma welding torch cannot be observed from the outside. Teaching the weld line to torch in real-time to be observable to humans will be difficult. Also, it is difficult to process the image to obtain the position of the weld line in K-PAW. In this study, a camera was utilized to observe the weld pool. The authors estimate the weld line position in real time by image processing based on U-Net prediction. The U-Net model demonstrates sufficient prediction where the accuracy reached 99.5% for the training data and 96.5% for the test data recognition. Moreover, a control method utilized weld line position estimated from the boundary area to verify the effectiveness of this prediction model from 3 mm within the deviation of 1 mm, which is within the range of permissible welding errors. It could reduce image processing errors in the weld pool image and provide higher recognition accuracy than image processing. Combining vision sensing technologies and deep learning methods will provide new technologies to enable higher welding precision and improve welding quality. It could also accelerate the development of welding technology in the intelligent manufacturing field.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Welding Techniques and Residual Stresses · Industrial Vision Systems and Defect Detection · Optical Systems and Laser Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School of Science and Engineering, Saitama University, Saitama 338-8570, Japan

School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China

School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China

Funding

National Natural Science Foundation of China · Natural Science Foundation of the Jiangsu Higher Education Institutions of China · China Postdoctoral Science Foundation · Japan Society for the Promotion of Science

References (25)

Show source-provided references
1. Development in plasma arc welding process: A review10.1016/j.matpr.2020.09.562 ↗
2. Correlation of reflected plasma angle and weld pool thermal state in plasma arc welding process10.1016/j.jmapro.2022.01.066 ↗
3. Influence of shielding gas composition on molten metal flow behavior during plasma keyhole arc welding process10.1016/j.jmapro.2020.03.031 ↗
4. Method for monitoring and controlling penetration of complex groove welding based on online multi-modal data10.1007/s10845-023-02107-2 ↗
5. The 3D narrow butt weld seam detection system based on the binocular consistency correction10.1007/s10845-022-01927-y ↗
6. Experimental sensing of molten flow velocity, weld pool and keyhole geometries in ultrasonic-assisted plasma arc welding10.1016/j.jmapro.2021.03.005 ↗
7. Effect of ultrasonic vibration on current density and keyholing capability of plasma arc10.1080/13621718.2020.1735062 ↗
8. Lu, Z., Zhang, W., Jiang, F., Chen, S., and Yan, Z. (2019). A primary study of variable polarity plasma arc welding using a pulsed plasma gas. Materials, 12.10.3390/ma12101666 ↗
9. Effect of pulsed power ultrasonic vibration on keyholing/penetrating capability in waveform-controlled plasma arc welding10.1007/s40194-021-01226-9 ↗
10. Jiao, Z., Qin, H., Gao, X., Feng, Z., Xu, Y., Chen, S., and Liu, W. (2023). Image Processing and Feature Extraction for Hull Structure GMAW Based on Weld Pool Visual Sensing. J. Sens., 2023.10.1155/2023/6317992 ↗
11. Xu, Y., and Wang, Z. (2021). Visual sensing technologies in robotic welding: Recent research developments and future interests. Sens. Actuators A Phys., 320.10.1016/j.sna.2021.112551 ↗
12. A high-dynamic-range visual sensing method for feature extraction of welding pool based on adaptive image fusion10.1007/s00170-021-07812-x ↗
13. Measurement of the keyhole entrance and topside weld pool geometries in keyhole plasma arc welding with dual CCD cameras10.1016/j.jmatprotec.2017.05.012 ↗
14. Single vision system for simultaneous observation of keyhole and weld pool in plasma arc welding10.1016/j.jmatprotec.2014.07.033 ↗
15. Automatic quality control of aluminum parts welds based on 3D data and artificial intelligence
16. Recognizing defects in stainless steel welds based on multi-domain feature expression and self-optimization10.1007/s10845-021-01849-1 ↗
17. Real-time laser keyhole welding penetration state monitoring based on adaptive fusion images using convolutional neural networks10.1007/s10845-021-01848-2 ↗
18. Penetration/keyhole status prediction and model visualization based on deep learning algorithm in plasma arc welding10.1007/s00170-021-07903-9 ↗
19. Image processing method for automatic tracking of the weld line in plasma robotic welding10.1007/s00170-015-8311-8 ↗
20. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
21. Zhang, B., Wang, X., Cui, J., and Yu, X. (2024). Automated Welding Defect Detection using Point-Rend ResUNet. J. Nondestruct. Eval., 43.10.1007/s10921-023-01019-8 ↗
22. Real-time identification of molten pool and keyhole using a deep learning-based semantic segmentation approach in penetration status monitoring10.1016/j.jmapro.2022.02.058 ↗
23. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
24. LabelMe: A database and web-based tool for image annotation10.1007/s11263-007-0090-8 ↗
25. Guo, C., Chen, X., Chen, Y., and Yu, C. (2022). Multi-Stage Attentive Network for Motion Deblurring via Binary Cross-Entropy Loss. Entropy, 24.10.3390/e24101414 ↗