Automated Fillet Weld Inspection Based on Deep Learning from 2D Images
Source abstract
Abstract
This work presents an automated welding inspection system based on a neural network trained through a series of 2D images of welding seams obtained in the same study. The object detection method follows a geometric deep learning model based on convolutional neural networks. Following an extensive review of available solutions, algorithms, and networks based on this convolutional strategy, it was determined that the You Only Look Once algorithm in its version 8 (YOLOv8) would be the most suitable for object detection due to its performance and features. Consequently, several models have been trained to enable the system to predict specific characteristics of weld beads. Firstly, the welding strategy used to manufacture the weld bead was predicted, distinguishing between two of them (Flux-Cored Arc Welding (FCAW)/Gas Metal Arc Welding (GMAW)), two of the predominant welding processes used in many industries, including shipbuilding, automotive, and aeronautics. In a subsequent experiment, the distinction between a well-manufactured weld bead and a defective one was predicted. In a final experiment, it was possible to predict whether a weld seam was well-manufactured or not, distinguishing between three possible welding defects. The study demonstrated high performance in three experiments, achieving top results in both binary classification (in the first two experiments) and multiclass classification (in the third experiment). The average prediction success rate exceeded 97% in all three experiments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Welding Techniques and Residual Stresses · Industrial Vision Systems and Defect Detection · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computers Engineering, 11519 Cadiz, Spain
Department of Automatic, Electronic, Computer Architecture & Communication Networks Engineering, 11519 Cadiz, Spain
Department of Mechanical Engineering and Industrial Design, 11519 Cadiz, Spain
Funding
Ministry of Science, Innovation and Universities
References (49)
Show source-provided references
1. Oh, S.J., Jung, M.J., Lim, C., and Shin, S.C. (2020). Automatic detection of welding defects using faster R-CNN. Appl. Sci., 10.10.3390/app10238629 ↗
2. The Effect of Flux Core Arc Welding (FCAW) Processes on Different Parameters10.1016/j.proeng.2012.07.341 ↗
3. The Effect of Gas Metal Arc Welding (GMAW) Processes on Different Welding Parameters10.1016/j.proeng.2012.07.342 ↗
4. Simulation and parameter optimization of flux cored arc welding using artificial neural network and particle swarm optimization algorithm10.1007/s10845-012-0675-0 ↗
5. An artificial neural network approach for parametric study on welding defect classification
6. A study on prediction of bead height in robotic arc welding using a neural network10.1016/S0924-0136(02)00803-8 ↗
7. Bronstein, M.M., Bruna, J., Cohen, T., and Veličković, P. (2021). Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges. arXiv.
8. Prediction of welding residual stress and deformation in electro-gas welding using artificial neural network10.1016/j.mtcomm.2021.102786 ↗
9. Real-time penetration state monitoring using convolutional neural network for laser welding of tailor rolled blanks10.1016/j.jmsy.2020.01.006 ↗
10. Welding Surface Inspection of Armatures via CNN and Image Comparison10.1109/JSEN.2021.3079334 ↗
11. Nele, L., Mattera, G., and Vozza, M. (2022). Deep Neural Networks for Defects Detection in Gas Metal Arc Welding. Appl. Sci., 12.10.3390/app12073615 ↗
12. GDXray: The Database of X-ray Images for Nondestructive Testing10.1007/s10921-015-0315-7 ↗
13. Längle, T., and Heizmann, M. (2020). Camera-based spatter detection in laser welding with a deep learning approach. Forum Bildverarbeitung 2020, KIT Scientific Publishing.10.1515/teme-2021-0076 ↗
14. Unsupervised weld defect classification in radiographic images using multivariate generalized Gaussian mixture model with exact computation of mean and shape parameters10.1016/j.compind.2019.02.010 ↗
15. Deng, H., Cheng, Y., Feng, Y., and Xiang, J. (2021). Industrial laser welding defect detection and image defect recognition based on deep learning model developed. Symmetry, 13.10.3390/sym13091731 ↗
16. Using Deep Learning for Defect Classification on a Small Weld X-ray Image Dataset10.1007/s10921-020-00719-9 ↗
17. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
18. S-RPN: Sampling-balanced region proposal network for small crop pest detection10.1016/j.compag.2021.106290 ↗
19. Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., and Garnett, R. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Advances in Neural Information Processing Systems, Curran Associates, Inc.
20. Huang, D.S., Huang, Z.K., and Hussain, A. (2019). A Welding Defect Identification Approach in X-ray Images Based on Deep Convolutional Neural Networks. Intelligent Computing Methodologies, Springer International Publishing.10.1007/978-3-030-26766-7_6 ↗
21. Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the Computer Vision—ECCV 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46454-1 ↗
22. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA.10.1109/CVPR.2016.91 ↗
23. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
24. Deep learning approach for defective spot welds classification using small and class-imbalanced datasets10.1016/j.neucom.2022.01.004 ↗
25. Girshick, R. (2015, January 13–16). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.169 ↗
26. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
27. Mask R-CNN10.1109/TPAMI.2018.2844175 ↗
28. Yun, G.H., Oh, S.J., and Shin, S.C. (2021). Image Preprocessing Method in Radiographic Inspection for Automatic Detection of Ship Welding Defects. Appl. Sci., 12.10.3390/app12010123 ↗
29. (2024, November 25). Hobbart. Choosing the Right Shielding Gases for Arc Welding|HobartWelders. Available online: https://www.hobartwelders.com/projects-and-advice/articles/choosing-the-right-shielding-gases-for-arc-welding.
30. (2024, December 06). Lascentrum. Hyundai SC-420MC. Available online: https://lascentrum.com/en/producten/hyundai-sm-70-eco/.
31. (2024, December 06). Lascentrum. Hyundai SM-70 eco. Available online: https://lascentrum.com/en/producten/hyundai-sc-420mc/.
32. (2024, December 06). Murray_Steel. S275JR Steel Plate. Available online: https://www.murraysteelproducts.com/products/s275jr.
33. Context and scale-aware YOLO for welding defect detection
34. Hussain, M. (2023). YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection. Machines, 11.10.3390/machines11070677 ↗
35. A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS10.3390/make5040083 ↗
36. (2024). Welding Consumables—Test Methods (Standard No. ISO Standard 15792-3:2011).
37. American Welding Society (2004). Specification for Carbon Steel Electrodes for Shielded Metal Arc Welding, American Welding Society. [14th ed.].
38. (2024). Welding and Allied Processes—Welding Positions (Standard No. ISO Standard 6947:2019).
39. (2024, October 29). IDS. Ensenso N Series. Available online: https://www.ids-imaging.us/ensenso-3d-camera-n-series.html.
40. Shinichi, S., Muraoka, R., Obinata, T., Shigeru, E., Horita, T., and Omata, K. (2004). Steel Products for Shipbuilding, JFE Holdings.
41. (2024, October 05). Roboflow. Computer Vision Tools for Developers and Enterprises. Available online: https://roboflow.com/.
42. Detecting Moving Objects in Dense Fog Environment using Fog-Aware-Detection Algorithm and YOLO
43. A survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗
44. Lin, T.Y., Maire, M., Belongie, S.J., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft COCO: Common Objects in Context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
45. Automatic object detection for behavioural research using YOLOv810.3758/s13428-024-02420-5 ↗
46. YOLO-Ultralytics (2024, October 05). Performance Metrics—Ultralytics YOLO Docs. Available online: https://docs.ultralytics.com/es/guides/yolo-performance-metrics/.
47. TEP940 (2024, October 25). Dataset Detection FCAW-GMAW Welding. Available online: https://universe.roboflow.com/weldingpic/weld_fcaw_gmaw.
48. TEP940 (2024, November 01). Dataset Detection WELD_GOOD_BAD Welding. Available online: https://universe.roboflow.com/weldingpic/weldgoodbad.
49. TEP940 (2024, October 30). GOOD-OP-LOP-UNDER Dataset. Available online: https://universe.roboflow.com/weldingpic/good-op-lop-under.