Intelligent Perception and Seam Tracking System for Thick Plate Weldments Based on Constant-Focus Optical Path
Source abstract
Abstract
To achieve efficient and accurate thick plate welding, as well as to precisely extract and plan the paths of complex three-dimensional weld seams in large steel structures, this study introduces a novel vision-guided approach for robotic welding systems utilizing a constant-focus laser sensor. This methodology specifically targets and mitigates several critical shortcomings inherent in conventional vision-guided welding techniques, including limited detection ranges, diminished precision in both detection and tracking, and suboptimal real-time performance. For preprocessed weld images, an improved grayscale extreme centroid method was developed to extract the center of the light stripe. Furthermore, a sophisticated feature point extraction algorithm, which integrates a maximum distance search strategy with a least-squares fitting procedure, was developed to facilitate the precise and timely identification of weld seam characteristic points. To further optimize the outcomes, a cylindrical filtering mechanism was employed to eliminate substantial discrepancies, whereas local Non-Uniform Rational B-Spline (NURBS) curve interpolation was utilized for the generation of smooth and accurate trajectory plans. A spatial vector-based pose adjustment strategy was then implemented to provide robust guidance for the welding robot, ensuring the successful execution of the welding operations. The experimental results indicated that the proposed algorithm achieved a tracking error of 0.3197 mm for welding workpieces with a thickness of 60 mm, demonstrating the method’s substantial potential in the manufacturing sector, especially in the domain of automated welding.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Welding Techniques and Residual Stresses · Optical measurement and interference techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
China Construction Second Engineering Bureau Ltd., Beijing 101101, China
Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
Funding
infrastructure technology and equipment engineering research center of the China State Construction Engineering Corporation
References (34)
Show source-provided references
1. Intelligent welding system technologies: State-of-the-art review and perspectives10.1016/j.jmsy.2020.06.020 ↗
2. Application of sensing technology in intelligent robotic arc welding: A review10.1016/j.jmapro.2022.05.029 ↗
3. Flexible robot sealant dispensing cell using RGB-D sensor and off-line programming10.1016/j.rcim.2017.04.004 ↗
4. Research on Welding Guidance System of Intelligent Perception for Steel Weldment10.1109/JSEN.2023.3235454 ↗
5. An Intelligent Path Planning of Welding Robot Based on Multisensor Interaction10.1109/JSEN.2023.3252637 ↗
6. Experiments on Calibrating Tilt-Shift Lenses for Close-Range Photogrammetry
7. Structure light telecentric stereoscopic vision 3D measurement system based on Scheimpflug condition10.1016/j.optlaseng.2016.05.021 ↗
8. Review of Calibration Methods for Scheimpflug Camera
9. Self-calibration of Scheimpflug cameras: An easy protocol10.1088/0957-0233/18/8/037 ↗
10. Zhou, X.Z.T. (2015, January 6–9). Generic Scheimpflug camera model and its calibration. Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.
11. Legarda, A., Izaguirre, A., Arana, N., and Iturrospe, A. (2011, January 1–3). A new method for Scheimpflug camera calibration. Proceedings of the 2011 10th International Workshop on Electronics, Control, Measurement and Signals, Liberec, Czech Republic.10.1109/IWECMS.2011.5952376 ↗
12. Another look at volume self-calibration: Calibration and self-calibration within a pinhole model of Scheimpflug cameras10.1088/0957-0233/27/9/094004 ↗
13. A Comprehensive and Versatile Camera Model for Cameras with Tilt Lenses10.1007/s11263-016-0964-8 ↗
14. Zhang, G., Zhang, Y., Tuo, S., Hou, Z., Yang, W., Xu, Z., Wu, Y., Yuan, H., and Shin, K. (2021). A Novel Seam Tracking Technique with a Four-Step Method and Experimental Investigation of Robotic Welding Oriented to Complex Welding Seam. Sensors, 21.10.3390/s21093067 ↗
15. Feature Extraction of Welding Seam Image Based on Laser Vision10.1109/JSEN.2018.2824660 ↗
16. Weld line detection and process control for welding automation10.1088/0957-0233/18/3/034 ↗
17. A Method of Feature Extraction of Position Detection and Weld Gap for GMAW Seam Tracking System of Fillet Weld With Variable Gaps10.1109/JSEN.2021.3106696 ↗
18. Narrow Weld Joint Recognition Method Based on Laser Profile Sensor10.1109/JSEN.2022.3223778 ↗
19. An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding10.1016/j.sna.2019.111533 ↗
20. Discerning Weld Seam Profiles from Strong Arc Background for the Robotic Automated Welding Process via Visual Attention Features10.1186/s10033-020-00438-2 ↗
21. Multi-Layer and Multi-Channel Dynamic Routing Planning and Initial Point Positioning of Weld Seam Based on Machine Vision10.1109/ACCESS.2023.3319076 ↗
22. A Novel 3-D Path Extraction Method for Arc Welding Robot Based on Stereo Structured Light Sensor10.1109/JSEN.2018.2877976 ↗
23. Intelligent Guidance Programming of Welding Robot for 3D Curved Welding Seam10.1109/ACCESS.2021.3065956 ↗
24. Development of a dynamics-based NURBS interpolator with real-time look-ahead algorithm10.1016/j.ijmachtools.2007.06.005 ↗
25. Adaptive-feedrate interpolation for parametric curves with a confined chord error10.1016/S0010-4485(01)00082-3 ↗
26. A high-precision non-uniform rational B-spline interpolator based on S-shaped feedrate scheduling10.1007/s00170-022-09411-w ↗
27. Real-time line-structured light measurement system based on Scheimpflug principle10.1007/s10043-021-00681-5 ↗
28. A new two-step method for tilt/shift camera self-calibration10.1360/N092017-00235 ↗
29. Calibration method for line-structured light vision sensor based on a single ball target10.1016/j.optlaseng.2015.01.008 ↗
30. Application of combinatorial optimization algorithm in industrial robot hand eye calibration10.1016/j.measurement.2022.111815 ↗
31. Survey on Linear Structured Light Stripe Center Extraction10.3788/LOP50.100002 ↗
32. Huang, Y., Kang, W., and Lu, Z. (2024). Improved Structured Light Centerline Extraction Algorithm Based on Unilateral Tracing. Photonics, 11.10.3390/photonics11080723 ↗
33. Chen, Y. (2015). Study on Modeling Method of NURBS Complex Free Surface. [Master’s Thesis, Chang’an University].
34. Huo, Y. (2011). The Effect of Interpolation Methods on the CNC Milling Quality. [Master’s Thesis, Chang’an University].