journal article·2024-07-03

A welding defect detection method based on multiscale feature enhancement and aggregation

Lukui Shi, Shiyuan Zhao, Weifei Niu

Publisher page

Abstract

Welding defects can pose significant safety risks in the industrial production. Accurate detection of these defects is crucial for ensuring the industrial production safety. Traditional computer vision methods rely on operator experience and knowledge and are time-consuming. In addition, manual feature extraction and classifier definition become more difficult for complex images or unknown defects. In contrast, deep learning can automatically extract features from raw data and build classifiers with higher accuracy. Additionally, deep learning models have stronger generalization ability and can identify a wider range of defects, without being limited by feature engineering. Consequently, we proposed a welding defect detection model based on multiscale feature enhancement and aggregation based on the advanced deep learning model YOLOv7. The model is composed of a wavelet multiscale attention (WMA), a parallel sampling module (PSS), and a path expansion aggregation network (PEANet). We compared the model with a variety of excellent object detection algorithms. Experiments show that the proposed model can effectively identify welding defects. Compared with the original model, the mAP has increased by approximately 1.2%, the average recall has increased by approximately 5.3%, the parameter volume has increased slightly, and the Flops has decreased by approximately 62.6%..
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Welding Techniques and Residual Stresses · Non-Destructive Testing Techniques · Industrial Vision Systems and Defect Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Artificial Intelligence, Hebei University of Technology, Tianjin, China

Tianjin Special Equipment Inspection Institute, Tianjin, China

Funding

Tianjin Science and Technology Key RD Program

References (40)

Show source-provided references
1. 10.1080/10589759.2020.177458210.1080/10589759.2020.1774582 ↗
2. 10.1109/ICCCT2.2019.882488410.1109/ICCCT2.2019.8824884 ↗
3. 10.1016/j.measurement.2021.10913010.1016/j.measurement.2021.109130 ↗
4. 10.1016/j.measurement.2020.10801310.1016/j.measurement.2020.108013 ↗
5. 10.1109/TIM.2020.303016710.1109/TIM.2020.3030167 ↗
6. 10.1109/CVPR.2014.8110.1109/CVPR.2014.81 ↗
7. 10.1109/5.72679110.1109/5.726791 ↗
8. 10.1109/TPAMI.2015.238982410.1109/TPAMI.2015.2389824 ↗
9. 10.1109/ICCV.2015.16910.1109/ICCV.2015.169 ↗
10. Ren S, He K, Girshick R, et al. Faster r-cnn: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence N, Lee D, Sugiyama M, and Garnett R, editors Advances in Neural Information Processing Systems. Vol. 28. Montreal Canada: Curran Associates, Inc; 2015.
11. 10.1109/ICCV.2017.32210.1109/ICCV.2017.322 ↗
12. 10.1109/ICCV.2019.0061510.1109/ICCV.2019.00615 ↗
13. 10.1007/978-3-030-58555-6_1610.1007/978-3-030-58555-6_16 ↗
14. 10.1109/TIM.2021.311631510.1109/TIM.2021.3116315 ↗
15. 10.1016/j.measurement.2022.11072810.1016/j.measurement.2022.110728 ↗
16. 10.1016/j.measurement.2021.10918510.1016/j.measurement.2021.109185 ↗
17. 10.1155/2018/483297210.1155/2018/4832972 ↗
18. 10.1109/ICIST52614.2021.944058010.1109/ICIST52614.2021.9440580 ↗
19. Ji W PW, Du M. Research on gear appearance defect recognition based on improved faster r-cnn. J Syst Simul. 2019;31:2198–2205.
20. 10.1007/978-3-319-46448-0_210.1007/978-3-319-46448-0_2 ↗
21. 10.1109/CVPR.2016.9110.1109/CVPR.2016.91 ↗
22. 10.1109/CVPR.2017.69010.1109/CVPR.2017.690 ↗
23. Redmon J Farhadi A. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767. 2018. http://arxiv.org/abs/1804.02767
24. Bochkovskiy A Wang C Liao HM. Yolov4: optimal speed and accuracy of object detection. 2020. https://arxiv.org/abs/2004.10934
25. Ge Z Liu S Wang F et al. YOLOX: exceeding YOLO series in 2021. 2021. https://arxiv.org/abs/2107.08430
26. 10.1063/5.005385110.1063/5.0053851 ↗
27. 10.1016/j.autcon.2020.10351410.1016/j.autcon.2020.103514 ↗
28. 10.1016/j.measurement.2021.11068310.1016/j.measurement.2021.110683 ↗
29. 10.1109/ACCESS.2022.319590110.1109/ACCESS.2022.3195901 ↗
30. 10.1155/2021/732139410.1155/2021/7321394 ↗
31. Wang CY Bochkovskiy A Liao HYM Yolov7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors 2022. URL:https://arxiv.org/abs/2207.02696.10.1109/CVPR52729.2023.00721 ↗
32. 10.1109/CVPR42600.2020.0046110.1109/CVPR42600.2020.00461 ↗
33. Liu Y Shao Z Hoffmann N. Global attention mechanism: retain information to enhance channel-spatial interactions. arXiv Preprint arXiv: 2112 05561. 2021. https://arxiv.org/abs/2112.05561
34. 10.1109/CVPR.2019.0031410.1109/CVPR.2019.00314 ↗
35. 10.1109/CVPR.2018.0074510.1109/CVPR.2018.00745 ↗
36. 10.1109/CVPR42600.2020.0115510.1109/CVPR42600.2020.01155 ↗
37. 10.1007/978-3-030-01234-2_110.1007/978-3-030-01234-2_1 ↗
38. 10.1109/ICCV.2015.17010.1109/ICCV.2015.170 ↗
39. 10.1007/978-3-030-01264-9_810.1007/978-3-030-01264-9_8 ↗
40. 10.1007/978-3-031-26409-2_2710.1007/978-3-031-26409-2_27 ↗