A 3D Vision-Based Weld Seam Extraction Method for Arbitrarily Placed Spatial Planar Weldments
Source abstract
Abstract
Vision-based weld seam extraction poses a significant challenge for weldments with complex spatial structures in automated welding. Existing research primarily focuses on identifying weld seams from weldments with given positions and postures, while practical weld path planning requires multiple weld seams identified within arbitrarily placed weldments. This paper proposes a methodology that identifies weld seams from arbitrarily placed spatial planar weldments in a single run. First, by introducing a turntable calibrated with respect to a 3D camera, we perform 3D reconstruction on an arbitrarily placed spatial planar weldment. Second, an improved RANSAC algorithm based on Euclidean clustering is proposed to carry out plane segmentation, focusing on segmentation accuracy. Finally, we present a novel weld seam extraction algorithm leveraging the half-edge data structure to efficiently compute weld seams from the segmented planes. The experiments conducted in this study demonstrate that the average segmentation errors (as an indirect indicator of weld seam extraction error) are reduced by 90.3% to 99.8% over conventional segmentation methods, and the standard deviations are reduced by 64.8% to 97.0%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Welding Techniques and Residual Stresses · Manufacturing Process and Optimization · Laser and Thermal Forming Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Fluid Power and Mechatronic Systems, College of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
Key Laboratory of 3D Printing Process and Equipment of Zhejiang Province, College of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
Funding
Key Research and Development Plan of Zhejiang Province
References (25)
Show source-provided references
1. Weld seam feature point extraction using laser and vision sensor10.1007/s00170-023-11776-5 ↗
2. A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision10.1007/s00170-016-9481-8 ↗
3. A V-shaped weld seam measuring system for large workpieces based on image recognition10.1007/s00170-022-10507-6 ↗
4. Real-time detection and localization method for weld seam of narrow butt joint based on semantic segmentation10.1088/1361-6501/ad16b9 ↗
5. A novel approach for robotic welding trajectory recognition based on pseudo-binocular stereo vision10.1016/j.optlastec.2024.110669 ↗
6. A point cloud-based welding trajectory planning method for plane welds10.1007/s00170-022-10699-x ↗
7. A novel 3-D path extraction method for arc welding robot based on stereo structured light sensor10.1109/JSEN.2018.2877976 ↗
8. Automatic 3D seam extraction method for welding robot based on monocular structured light10.1109/JSEN.2021.3076341 ↗
9. Zhang, Y.K., Geng, Y.S., Tian, X.C., Zheng, F.Q., Jiang, Y., and Lai, M. (2024). A Feature Extraction Approach Over Workpiece Point Clouds for Robotic Welding. IEEE Trans. Autom. Sci. Eng., 1–10.10.1109/TASE.2023.3345868 ↗
10. A novel method for dense point cloud reconstruction and weld seam detection for tubesheet welding robot10.1016/j.optlastec.2023.109346 ↗
11. Autonomous programming and adaptive filling of lap joint based on three-dimensional welding-seam model by laser scanning10.1016/j.jmapro.2020.03.034 ↗
12. Suszyński, M., Peta, K., Černohlávek, V., and Svoboda, M. (2022). Mechanical Assembly Sequence Determination Using Artificial Neural Networks Based on Selected DFA Rating Factors. Symmetry, 14.10.3390/sym14051013 ↗
13. A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot10.1016/j.rcim.2019.101929 ↗
14. A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision10.1016/j.rcim.2022.102433 ↗
15. SLAM in dynamic environments via ML-RANSAC10.1016/j.mechatronics.2017.12.002 ↗
16. Giulietti, N., Allevi, G., Castellini, P., Garinei, A., and Martarelli, M. (2022). Rivers’ Water Level Assessment Using UAV Photogrammetry and RANSAC Method and the Analysis of Sensitivity to Uncertainty Sources. Sensors, 22.10.3390/s22145319 ↗
17. Plane detection in 3D point cloud using octree-balanced density down-sampling and iterative adaptive plane extraction10.1049/iet-ipr.2017.1076 ↗
18. Advances in Vision-Based Lane Detection: Algorithms, Integration, Assessment, and Perspectives on ACP-Based Parallel Vision10.1109/JAS.2018.7511063 ↗
19. Optimal RANSAC-towards a repeatable algorithm for finding the optimal set
20. Overview of the RANSAC Algorithm
21. Computation of surface geometry and segmentation using covariance techniques10.1109/34.334391 ↗
22. Semantic 3D object maps for everyday manipulation in human living environments10.1007/s13218-010-0059-6 ↗
23. Finding the intersection of two convex polyhedra10.1016/0304-3975(78)90051-8 ↗
24. An SVD-based turntable calibration method with multiple reference planes segmented from point clouds10.1088/1361-6501/acfa14 ↗
25. Rusu, R.B., and Cousins, S. (2011, January 9–13). 3D is here: Point cloud library (PCL). Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.10.1109/ICRA.2011.5980567 ↗