journal article·2021-08-17Open access

Development of Defect Detection AI Model for Wire + Arc Additive Manufacturing Using High Dynamic Range Images

Chaekyo Lee, Gijeong Seo, Duck Bong Kim, Minjae Kim, Jong-Ho Shin

Applied Sciences· Volume 11· Issue 16

Abstract

Wire + arc additive manufacturing (WAAM) utilizes a welding arc as a heat source and a metal wire as a feedstock. In recent years, WAAM has attracted significant attention in the manufacturing industry owing to its advantages: (1) high deposition rate, (2) low system setup cost, (3) wide diversity of wire materials, and (4) sustainability for constructing large-sized metal structures. However, owing to the complexity of arc welding in WAAM, more research efforts are required to improve its process repeatability and advance part qualification. This study proposes a methodology to detect defects of the arch welding process in WAAM using images acquired by a high dynamic range camera. The gathered images are preprocessed to emphasize features and used for an artificial intelligence model to classify normal and abnormal statuses of arc welding in WAAM. Owing to the shortage of image datasets for defects, transfer learning technology is adopted. In addition, to understand and check the basis of the model’s feature learning, a gradient-weighted class activation mapping algorithm is applied to select a model that has the correct judgment criteria. Experimental results show that the detection accuracy of the metal transfer region-of-interest (RoI) reached 99%, whereas that of the weld-pool and bead RoI was 96%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Welding Techniques and Residual Stresses · Additive Manufacturing Materials and Processes · Industrial Vision Systems and Defect Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Industrial Engineering, Chosun University, Gwangju 61452, Korea

Department of Manufacturing and Engineering Technology, Tennessee Technological University, Cookeville, TN 38505, USA

Funding

National Research Foundation of Korea · Institute for Information & Communications Technology Planning & Evaluation · National Science Foundation

References (63)

Show source-provided references
1. Strengthening of ferrous binder jet 3D printed components through bronze infiltration
2. Tandem metal inert gas process for high productivity wire arc additive manufacturing in stainless steel
3. Manufacture of complex thin-walled metallic objects using weld-deposition based additive manufacturing10.1016/j.rcim.2017.06.003 ↗
4. Ahsan, M.R.U., Fan, X., Seo, G.-J., Ji, C., Noakes, M., Nycz, A., Liaw, P.K., and Kim, D.B. (2020). Microstructures and mechanical behavior of the bimetallic additively-manufactured structure (BAMS) of austenitic stainless steel and Inconel 625. J. Mater. Sci. Technol.10.1016/j.jmst.2020.10.001 ↗
5. Heat-treatment effects on a bimetallic additively-manufactured structure (BAMS) of the low-carbon steel and austenitic-stainless steel
6. Invited review article: Strategies and processes for high quality wire arc additive manufacturing
7. A review on wire arc additive manufacturing: Monitoring, control and a framework of automated system10.1016/j.jmsy.2020.08.008 ↗
8. Tang, S., Wang, G., Zhang, H., and Wang, R. (2017, January 7–9). An online surface defects detection system for AWAM based on deep learning. Proceedings of the 28th Annual International Solid Freeform Fabrication Symposium, Austin, TX, USA.
9. Non-destructive testing application of radiography and ultrasound for wire and arc additive manufacturing
10. Additive manufacturing process monitoring and control by non-destructive testing techniques: Challenges and in-process monitoring10.1080/17452759.2017.1351201 ↗
11. Application of a hybrid 3D-2D laser scanning system to the characterization of slate slabs10.3390/s100605949 ↗
12. Automated vision system for quality inspection of slate slabs10.1016/j.compind.2018.03.030 ↗
13. Zhang, Y.M., Yang, Y.-P., Zhang, W., and Na, S.-J. (2020). Advanced welding manufacturing: A Brief analysis and review of challenges and solutions. J. Manuf. Sci. Eng., 142.10.1115/1.4047947 ↗
14. Modeling and Analysis of the arc light spectrum in GMAW
15. End-to-End prediction of weld penetration: A deep learning and transfer learning based method10.1016/j.jmapro.2020.01.044 ↗
16. DeepWelding: A Deep Learning Enhanced Approach to GTAW Using Multisource Sensing Images10.1109/TII.2019.2937563 ↗
17. An automated radiographic NDT system for weld inspection: Part I—Weld extraction10.1016/0963-8695(96)00009-6 ↗
18. Classification of welding flaw types with fuzzy expert systems10.1016/S0957-4174(03)00010-1 ↗
19. Automated Defect Recognition and Identification in Digital Radiography10.1007/s10921-013-0216-6 ↗
20. An on-line ANN-Based approach for quality estimation in resistance spot welding10.4028/www.scientific.net/AMR.112.141 ↗
21. Automatic Inspection system of welding radiographic images based on ANN Under a regularisation process10.1007/s10921-011-0118-4 ↗
22. Research on welding line defect recognition of the in-service pipeline using X-ray detecting10.4028/www.scientific.net/AMM.195-196.5 ↗
23. Automatic classification approach to weld defects based on PCA and SVM10.1784/insi.2012.55.10.535 ↗
24. A support vector machine approach for classification of welding defects from ultrasonic signals10.1080/10589759.2014.914210 ↗
25. Automated X-ray recognition of solder bump defects based on ensemble-ELM10.1007/s11431-018-9324-3 ↗
26. Ye, J., Ye, H., Li, Z., Peng, X., Zhou, J., and Guo, B. (2018). Improving stability of welding model with ME-ELM. Transactions on Intelligent Welding Manufacturing, Springer.10.1007/978-981-10-7043-3_4 ↗
27. A layers-overlapping strategy for robotic wire and arc additive manufacturing of multi-layer multi-bead components with homogeneous layers10.1007/s00170-018-1786-3 ↗
28. Modeling of bead section profile and overlapping beads with experimental validation for robotic GMAW-based rapid manufacturing10.1016/j.rcim.2012.09.011 ↗
29. Microstructure and mechanical properties of the austenitic stainless steel 316L fabricated by gas metal arc additive manufacturing10.1016/j.msea.2017.05.024 ↗
30. Thermal analysis for single-pass multi-layer GMAW based additive manufacturing using infrared thermography10.1016/j.jmatprotec.2017.01.024 ↗
31. Revealing internal flow behaviour in arc welding and additive manufacturing of metals10.1038/s41467-018-07900-9 ↗
32. Benjdira, B., Khursheed, T., Koubaa, A., Ammar, A., and Ouni, K. (2019, January 5–7). Car detection using unmanned aerial vehicles: Comparison between faster R-CNN and YOLOv3. Proceedings of the 2019 1st International Conference on Unmanned Vehicle Systems-Oman (UVS), Muscat, Oman.10.1109/UVS.2019.8658300 ↗
33. Bead modelling and implementation of adaptive MAT path in wire and arc additive manufacturing10.1016/j.rcim.2015.12.004 ↗
34. Bead geometry prediction for robotic GMAW-based rapid manufacturing through a neural network and a second-order regression analysis10.1007/s10845-012-0682-1 ↗
35. Weld image deep learning-based on-line defects detection using convolutional neural networks for Al alloy in robotic arc welding10.1016/j.jmapro.2019.06.023 ↗
36. Weld Reinforcement Analysis Based on Long-Term Prediction of Molten Pool Image in Additive Manufacturing10.1109/ACCESS.2020.2986130 ↗
37. Liu, B., Zhang, X., Gao, Z., and Chen, L. (2018). Weld Defect Images Classification with VGG16-Based Neural Network. Digital TV and Wireless Multimedia Communication, Springer.10.1007/978-981-10-8108-8_20 ↗
38. Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014, January 8–13). How transferable are features in deep neural networks?. Proceedings of the 27th International Conference on Neural Information Processing Systems—Volume 2, Montreal, QC, Canada.
39. Computer-Aided Diagnosis (CAD) of Pulmonary Nodule of Thoracic CT Image Using Transfer Learning10.1007/s10278-019-00204-4 ↗
40. A generic deep-learning-Based approach for automated surface inspection10.1109/TCYB.2017.2668395 ↗
41. A New image recognition and classification Method combining transfer learning algorithm and MobileNet model for welding defects10.1109/ACCESS.2020.3005450 ↗
42. Heat treatment effects on Inconel 625 components fabricated by wire + arc additive manufacturing (WAAM)—Part 1: Microstructural characterization10.1007/s00170-019-03828-6 ↗
43. Ward, G., Reinhard, E., and Debevec, P. (2008, January 11–15). High dynamic range imaging, image-based lighting. Proceedings of the ACM SIGGRAPH 2008 Classes, Los Angeles, CA, USA.10.1145/1401132.1401170 ↗
44. A Computational approach to edge detection10.1109/TPAMI.1986.4767851 ↗
45. Forming appearance analysis in multi-layer single-pass GMAW-based additive manufacturing10.1007/s00170-015-7112-4 ↗
46. Investigation of humping defect formation in a lap joint at a high-speed hybrid laser-GMA welding10.1016/j.rinp.2019.102341 ↗
47. Prevention of humping bead associated with high welding speed by double-electrode gas metal arc welding10.1007/s00170-012-3944-3 ↗
48. Using the multi-wire GMAW processes for controlling the formation of humping10.1007/s40194-017-0458-5 ↗
49. The humping phenomenon during high speed gas metal arc welding10.1179/174329305X44134 ↗
50. Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
51. A Survey on transfer learning10.1109/TKDE.2009.191 ↗
52. Dermatologist-level classification of skin cancer with deep neural networks10.1038/nature22985 ↗
53. Xie, S.M., Jean, N., Burke, M., Lobell, D., and Ermon, S. (2016, January 12–17). Transfer learning from deep features for remote sensing and poverty mapping. Proceedings of the 13th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.10.1609/aaai.v30i1.9906 ↗
54. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs10.1001/jama.2016.17216 ↗
55. Cross-Validatory choice and assessment of statistical predictions10.1111/j.2517-6161.1974.tb00994.x ↗
56. Chollet, F. (2021, August 02). Deep Learning Library for Theano and Tensorflow. Available online: https://keras.io.
57. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine learning on heterogeneous distributed systems. arXiv.
58. Grad-CAM: Visual Explanations from deep networks via gradient-based localization10.1007/s11263-019-01228-7 ↗
59. Chen, A., Jaegerman, J., Matic, D., Inayatali, H., Charoenkitkarn, N., and Chan, J. (2020, January 19–21). Detecting Covid-19 in chest X-rays using transfer learning with VGG16. Proceedings of the 11th International Conference on Computational Systems—Biology and Bioinformatics, Bangkok, Thailand.10.1145/3429210.3429213 ↗
60. Lee, K.-S.K., Kim, J.Y., Jeon, E.-T., Choi, W.S., Kim, N.H., and Lee, K.Y. (2020). Evaluation of scalability and degree of fine-tuning of deep Convolutional neural networks for COVID-19 screening on chest X-ray images using explainable deep-learning algorithm. J. Pers. Med., 10.10.3390/jpm10040213 ↗
61. Sarkar, S., Sharma, R., and Shah, K. (2020). Malaria detection from RBC images using shallow convolutional neural networks. arXiv.
62. Hata, E., Seo, C., Nakayama, M., Iwasaki, K., Ohkawauchi, T., and Ohya, J. (2020, January 20–24). Classification of aortic stenosis using ECG by deep learning and its analysis using Grad-CAM. Proceedings of the 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9175151 ↗
63. AUC: A misleading measure of the performance of predictive distribution models10.1111/j.1466-8238.2007.00358.x ↗