Real-Time Defect Detection for Metal Components: A Fusion of Enhanced Canny–Devernay and YOLOv6 Algorithms
Source abstract
Abstract
Due to the presence of numerous surface defects, the inadequate contrast between defective and non-defective regions, and the resemblance between noise and subtle defects, edge detection poses a significant challenge in dimensional error detection, leading to increased dimensional measurement inaccuracies. These issues serve as major bottlenecks in the domain of automatic detection of high-precision metal parts. To address these challenges, this research proposes a combined approach involving the utilization of the YOLOv6 deep learning network in conjunction with metal lock body parts for the rapid and accurate detection of surface flaws in metal workpieces. Additionally, an enhanced Canny–Devernay sub-pixel edge detection algorithm is employed to determine the size of the lock core bead hole. The methodology is as follows: The data set for surface defect detection is acquired using the labeling software lableImg and subsequently utilized for training the YOLOv6 model to obtain the model weights. For size measurement, the region of interest (ROI) corresponding to the lock cylinder bead hole is first extracted. Subsequently, Gaussian filtering is applied to the ROI, followed by a sub-pixel edge detection using the improved Canny–Devernay algorithm. Finally, the edges are fitted using the least squares method to determine the radius of the fitted circle. The measured value is obtained through size conversion. Experimental detection involves employing the YOLOv6 method to identify surface defects in the lock body workpiece, resulting in an achieved mean Average Precision (mAP) value of 0.911. Furthermore, the size of the lock core bead hole is measured using an upgraded technique based on the Canny–Devernay sub-pixel edge detection, yielding an average inaccuracy of less than 0.03 mm. The findings of this research showcase the successful development of a practical method for applying machine vision in the realm of the automatic detection of metal parts. This achievement is accomplished through the exploration of identification methods and size-measuring techniques for common defects found in metal parts. Consequently, the study establishes a valuable framework for effectively utilizing machine vision in the field of metal parts inspection and defect detection.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Welding Techniques and Residual Stresses · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Guangdong Laboratory for Lingnan Modern Agriculture, College of Engineering, South China Agricultural University, Guangzhou 510642, China
Guangdong Zhengzheng Construction Engineering Testing Co., Ltd., Guangzhou 510635, China
College of Urban and Rural Construction, Zhongkai University of Agriculture and Engineering, Guangzhou 510006, China
Funding
Laboratory of Lingnan Modern Agriculture Project · Guangdong Basic and Applied Basic Research Foundation
References (56)
Show source-provided references
1. Yang, J., Li, S., Wang, Z., Dong, H., Wang, J., and Tang, S. (2020). Using Deep Learning to Detect Defects in Manufacturing: A Comprehensive Survey and Current Challenges. Materials, 13.10.3390/ma13245755 ↗
2. Finding defects in texture using regularity and local orientation10.1016/S0031-3203(01)00188-1 ↗
3. Hou, Z., and Parker, J.M. (2005, January 5–7). Texture Defect Detection Using Support Vector Machines with Adaptive Gabor Wavelet Features. Proceedings of the 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION’05)—Volume 1, Breckenridge, CO, USA.
4. Zheng, S., Zhong, Q., Chen, X., Peng, L., and Cui, G. (2022). The Rail Surface Defects Recognition via Operating Service Rail Vehicle Vibrations. Machines, 10.10.3390/machines10090796 ↗
5. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
6. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
7. Detection of Power Line Insulator Defects Using Aerial Images Analyzed with Convolutional Neural Networks10.1109/TSMC.2018.2871750 ↗
8. Real-time Detection of Steel Strip Surface Defects Based on Improved YOLO Detection Network10.1016/j.ifacol.2018.09.412 ↗
9. An end-to-end learning method for industrial defect detection10.1108/AA-08-2018-114 ↗
10. Xie, W., Chen, H., Wang, Z., Liu, B., and Shuai, L. (2022). Display Line Defect Detection Method Based on Color Feature Fusion. Machines, 10.10.3390/machines10090723 ↗
11. A hierarchical training-convolutional neural network with feature alignment for steel surface defect recognition10.1016/j.rcim.2022.102507 ↗
12. Deep learning based online metallic surface defect detection method for wire and arc additive manufacturing10.1016/j.rcim.2022.102470 ↗
13. Defect detection in composites by deep learning using solitary waves10.1016/j.ijmecsci.2022.107882 ↗
14. An on-line stereo-vision system for dimensional measurements of rubber extrusions10.1016/j.measurement.2003.11.004 ↗
15. Accurate 3D measurement using a structured light system10.1016/S0262-8856(97)00053-X ↗
16. Stereo vision for 3D measurement: Accuracy analysis, calibration and industrial applications10.1016/S0263-2241(96)00065-6 ↗
17. Size measurement based on a two-camera machine vision system for the bayonets of automobile brake pads10.1016/j.measurement.2018.03.017 ↗
18. An online visual measurement method for workpiece dimension based on deep learning10.1016/j.measurement.2021.110032 ↗
19. Research on the on-line dimensional accuracy measurement method of conical spun workpieces based on machine vision technology10.1016/j.measurement.2019.106881 ↗
20. On-line measurement of the straightness of seamless steel pipes using machine vision technique10.1016/S0924-4247(01)00683-5 ↗
21. An improved image acquiring method for machine vision measurement of hot formed parts10.1016/j.jmatprotec.2009.09.009 ↗
22. Rapid non-contact visual measurement method for key dimensions of revolving workpieces10.1051/ijmqe/2021008 ↗
23. Online deviation measurement system of the strip in the finishing process based on machine vision10.1016/j.measurement.2022.111735 ↗
24. Development of a vision-based high precision position and orientation measurement system to facilitate automation of workpiece installation in machine tools10.1016/j.cirpj.2022.05.019 ↗
25. Research on dynamic measurement of hot ring rolling dimension based on machine vision10.1016/j.ifacol.2022.05.022 ↗
26. Non-horizontal target measurement method based on monocular vision10.1080/21642583.2022.2068167 ↗
27. Zhang, W., Han, Z., Li, Y., Zheng, H., and Cheng, X. (2022). A Method for Measurement of Workpiece form Deviations Based on Machine Vision. Machines, 10.10.2139/ssrn.4115759 ↗
28. Luo, L., Liu, W., Lu, Q., Wang, J., Wen, W., Yan, D., and Tang, Y. (2021). Grape Berry Detection and Size Measurement Based on Edge Image Processing and Geometric Morphology. Machines, 9.10.3390/machines9100233 ↗
29. Novel visual crack width measurement based on backbone double-scale features for improved detection automation10.1016/j.engstruct.2022.115158 ↗
30. A Sub-Pixel Edge Detector: An Implementation of the Canny/Devernay Algorithm10.5201/ipol.2017.216 ↗
31. Survey on industrial defect detection with deep learning10.1360/SSI-2021-0336 ↗
32. A Review of Typical Object Detection Algorithms in Deep Learning
33. Detection and counting of banana bunches by integrating deep learning and classic image-processing algorithms10.1016/j.compag.2023.107827 ↗
34. Rachis detection and three-dimensional localization of cut off point for vision-based banana robot10.1016/j.compag.2022.107079 ↗
35. Visual measurement of dam concrete cracks based on U-net and improved thinning algorithm
36. Machine-learning-assisted shear strength prediction of reinforced concrete beams with and without stirrups10.1007/s00366-020-01076-x ↗
37. Machine learning-aided design and prediction of cementitious composites containing graphite and slag powder10.1016/j.jobe.2021.102544 ↗
38. Sun, J., Wang, J., Zhu, Z., He, R., Peng, C., Zhang, C., Huang, J., Wang, Y., and Wang, X. (2022). Mechanical Performance Prediction for Sustainable High-Strength Concrete Using Bio-Inspired Neural Network. Buildings, 12.10.3390/buildings12010065 ↗
39. Multi-objective optimisation of a graphite-slag conductive composite applying a BAS-SVR based model10.1016/j.jobe.2021.103223 ↗
40. Surface Roughness Estimation and Chatter Vibration Identification Using Vision-Based Deep Learning10.2493/jjspe.85.658 ↗
41. Zhou, Y., Tang, Y., Zou, X., Wu, M., Tang, W., Meng, F., Zhang, Y., and Kang, H. (2022). Adaptive Active Positioning of Camellia oleifera Fruit Picking Points: Classical Image Processing and YOLOv7 Fusion Algorithm. Appl. Sci., 12.10.3390/app122412959 ↗
42. Zhang, Y., Liu, X., Guo, J., and Zhou, P. (2022). Surface Defect Detection of Strip-Steel Based on an Improved PP-YOLOE-m Detection Network. Electronics, 11.10.3390/electronics11162603 ↗
43. Ge, H., Dai, Y., Zhu, Z., and Liu, R. (2022). A Deep Learning Model Applied to Optical Image Target Detection and Recognition for the Identification of Underwater Biostructures. Machines, 10.10.3390/machines10090809 ↗
44. Toward surface defect detection in electronics manufacturing by an accurate and lightweight YOLO-style object detector10.1038/s41598-023-33804-w ↗
45. Ge, Y., Lin, S., Zhang, Y., Li, Z., Cheng, H., Dong, J., Shao, S., Zhang, J., Qi, X., and Wu, Z. (2022). Tracking and Counting of Tomato at Different Growth Period Using an Improving YOLO-Deepsort Network for Inspection Robot. Machines, 10.10.3390/machines10060489 ↗
46. Seismic performance evaluation of recycled aggregate concrete-filled steel tubular columns with field strain detected via a novel mark-free vision method10.1016/j.istruc.2021.12.055 ↗
47. Experimental and numerical studies on single-layer reticulated shells with aluminium alloy gusset joints10.1016/j.tws.2017.05.007 ↗
48. Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model10.1016/j.engstruct.2022.115406 ↗
49. Hybrid cement composite-based sensor for in-situ chloride monitoring in concrete structures10.1016/j.snb.2023.133638 ↗
50. Numerical analysis of aluminium alloy gusset joints subjected to bending moment and axial force10.1016/j.engstruct.2017.09.005 ↗
51. A Survey of Gaussian Convolution Algorithms10.5201/ipol.2013.87 ↗
52. A Computational Approach to Edge Detection10.1109/TPAMI.1986.4767851 ↗
53. Devernay, F. (1995). A Non-Maxima Suppression Method for Edge Detection with Sub-Pixel Accuracy. [Ph.D. Thesis, INRIA].
54. An Improved Canny-Zernike Subpixel Detection Algorithm
55. Tang, R., Chen, W., Wu, Y., Xiong, H., and Yan, B. (2023). A Comparative Study of Structural Deformation Test Based on Edge Detection and Digital Image Correlation. Sensors, 23.10.3390/s23083834 ↗
56. Lin, E., Tu, C., and Lien, J.J. (2023). Nut Geometry Inspection Using Improved Hough Line and Circle Methods. Sensors, 23.10.3390/s23083961 ↗