journal article·2025-07Open access

Automated detection of weld defects in TOFD images for steel bridges using generative adversarial networks

Yanfeng Gong, Zihao Chen, Hong Zhang, Meng Xu, Wen Deng

Abstract

Time-of-flight diffraction (TOFD) has been widely adopted for weld defect detection in bridge steel quality assurance due to its harmlessness to the human body, real-time performance, and satisfactory detection accuracy. Most deep learning-based methods for automated weld defect recognition rely heavily on defect samples. In practice, such samples are scarce in steel bridge applications because modern welding technologies significantly reduce defect occurrence. To address this limitation, we propose a two-stage defect detection method for TOFD weld images based on an enhanced generative adversarial network (GAN) that operates without requiring defect-containing samples. In the first stage, the Region of Interest (ROI) which contains potential defects is localized using YOLOv8. In the second stage, the extracted ROI is sliced into patches and analyzed by a GAN architecture enhanced with a self-attention mechanism, which improves the encoding and aggregation of local defect features. The integration of the self-attention GAN with the slicing strategy further enhances defect recognition performance. The proposed method is evaluated on a self-constructed TOFD dataset of steel bridge welds. Experimental results demonstrate that our approach achieves an AUC of 86%, outperforming existing state-of-the-art methods by 5%.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Welding Techniques and Residual Stresses · Non-Destructive Testing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (31)

Show source-provided references
1. Computer vision-based surface defect identification method for weld images10.1016/j.matlet.2024.136972 ↗
2. Zero-defect manufacturing and automated defect detection using time of flight diffraction (TOFD) images10.3390/machines10100839 ↗
3. Welding Defect Classification from Simulated Ultrasonic Signals10.1007/s10921-018-0496-y ↗
4. "Segmented analysis of time-of-flight diffraction ultrasound for flaw detection in welded steel plates using extreme learning machines10.1016/j.ultras.2019.106057 ↗
5. "Sizing of flaws using ultrasonic bulk wave testing: A review10.1016/j.ultras.2018.03.003 ↗
6. "Development of an ultrasonic weld inspection system based on image processing and neural networks10.1080/10589759.2017.1376056 ↗
7. "Automatic Recognition of Weld Defects in TOFD D-Scan Images Based on Faster R-CNN10.1520/JTE20170563 ↗
8. "An end-to-end welding defect detection approach based on titanium alloy time-of-flight diffraction images10.1007/s10845-021-01905-w ↗
9. "Research on Detection Method for Welding Seam Defects in Ultrasonic TOFD Image Based on Mask R-CNN
10. "Deep Learning for Ultrasonic Crack Characterization in NDE10.1109/TUFFC.2020.3045847 ↗
11. "Manufacturing Processes Quality Control as a Main Factor of Performance Enhancement in Industrial Management10.1109/EIConRus.2019.8657176 ↗
12. "Safety Situation and Defects Analysis of Spherical Tanks from Big Data Perspective10.1109/MLBDBI48998.2019.00076 ↗
13. "Anomaly detection methods for infrequent failures in resistive steel welding10.1016/j.jmapro.2021.12.003 ↗
14. "Deep Unsupervised Anomaly Detection
15. "Abnormal event detection in crowded scenes using one-class SVM10.1007/s11760-018-1267-z ↗
16. "GODS: Generalized One-class Discriminative Subspaces for Anomaly Detection10.1109/ICCV.2019.00829 ↗
17. Deep autoencoding gaussian mixture model for unsupervised anomaly detection
18. "Welding fault detection and diagnosis using one-class SVM with distance substitution kernels and random convolutional kernel transform10.1007/s00170-023-11768-5 ↗
19. "Learning Deep Features for One-Class Classification10.1109/TIP.2019.2917862 ↗
20. "A Deep One-Class Neural Network for Anomalous Event Detection in Complex Scenes
21. R. Chalapathy, A.K. Menon, and S. Chawla, “Anomaly detection using one-class neural networks,” arXiv preprint arXiv:1802.06360, 2018. https://doi.org/10.48550/arXiv.1802.06360.
22. "GANomaly: Semi-supervised Anomaly Detection via Adversarial Training
23. "A normal weld recognition method for time-of-flight diffraction detection based on generative adversarial network10.1007/s10845-022-02041-9 ↗
24. "Defect Classification and Detection Using a Multitask Deep One-Class CNN10.1109/TASE.2021.3109353 ↗
25. "Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders
26. "Generative Adversarial Nets
27. "Adversarially Learned One-Class Classifier for Novelty Detection10.1109/CVPR.2018.00356 ↗
28. "Bottleneck Transformers for Visual Recognition10.1109/CVPR46437.2021.01625 ↗
29. "An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
30. "The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation10.1186/s12864-019-6413-7 ↗
31. L. Ruff, R.A. Vandermeulen, N. Görnitz, L. Deecke, and M. Kloft, "Deep One-Class Classification," International Conference on Machine Learning, 2018.