journal article·2024-09-03Open access

Enhanced Scratch Detection for Textured Materials Based on Optimized Photometric Stereo Vision and Fast Fourier Transform–Gabor Filtering

Yaoshun Yue, Wenpeng Sang, Kaiwei Zhai, Maohai Lin

Applied Sciences· Volume 14· Issue 17

Abstract

In the process of scratch defect detection in textured materials, there are often problems of low efficiency in traditional manual detection, large errors in machine vision, and difficulty in distinguishing defective scratches from the background texture. In order to solve these problems, we developed an enhanced scratch defect detection system for textured materials based on optimized photometric stereo vision and FFT-Gabor filtering. We designed and optimized a novel hemispherical image acquisition device that allows for selective lighting angles. This device integrates images captured under multiple light sources to obtain richer surface gradient information for textured materials, overcoming issues caused by high reflections or dark shadows under a single light source angle. At the same time, for the textured material, scratches and a textured background are difficult to distinguish; therefore, we introduced a Gabor filter-based convolution kernel, leveraging the fast Fourier transform (FFT), to perform convolution operations and spatial domain phase subtraction. This process effectively enhances the defect information while suppressing the textured background. The effectiveness and superiority of the proposed method were validated through material applicability experiments and comparative method evaluations using a variety of textured material samples. The results demonstrated a stable scratch capture success rate of 100% and a recognition detection success rate of 98.43% ± 1.0%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Surface Roughness and Optical Measurements · Optical measurement and interference techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Biobased Material and Green Papermaking, Faculty of Light Industry, Qilu University of Technology, Jinan 250300, China

Faculty of Light Industry, Qilu University of Technology, Jinan 250300, China

References (50)

Show source-provided references
1. A machine vision based automated quality control system for product dimensional analysis10.1016/j.procs.2021.05.014 ↗
2. Iyshwerya, K., Janani, B., Krithika, S., and Manikandan, T. (2013, January 28–29). Defect Detection Algorithm for High Speed Inspection in Machine Vision. Proceedings of the International Conference on Smart Structures and Systems-ICSSS’13, Chennai, India.10.1109/ICSSS.2013.6623010 ↗
3. A machine vision based automatic optical inspection system for measuring drilling quality of printed circuit boards10.1109/ACCESS.2016.2631658 ↗
4. Baygin, M., Karakose, M., Sarimaden, A., and Erhan, A. (2017, January 16–17). Machine vision based defect detection approach using image processing. Proceedings of the 2017 International Artificial Intelligence and Data Processing Symposium (IDAP), Malatya, Turkey.10.1109/IDAP.2017.8090292 ↗
5. Machine learning approach for automated visual inspection of machine components10.1016/j.eswa.2010.09.012 ↗
6. A surface defects inspection method based on multidirectional gray-level fluctuation10.1177/1729881417703114 ↗
7. Yazdchi, M., Yazdi, M., and Mahyari, A.G. (2009, January 7–9). Steel surface defect detection using texture segmentation based on multifractal dimension. Proceedings of the 2009 International Conference on Digital Image Processing, Bangkok, Thailand.10.1109/ICDIP.2009.68 ↗
8. Pastor-López, I., Sanz, B., de la Puerta, J.G., and Bringas, P.G. (2019, January 4–6). Surface defect modelling using co-occurrence matrix and fast fourier transformation. Proceedings of the Hybrid Artificial Intelligent Systems: 14th International Conference, HAIS 2019, León, Spain. Proceedings 14.10.1007/978-3-030-29859-3_63 ↗
9. Fabric defect detection by Fourier analysis10.1109/28.871274 ↗
10. Optimization of automated online fabric inspection by fast Fourier transform (FFT) and cross-correlation10.1177/0040517512458340 ↗
11. Accurate and efficient inspection of speckle and scratch defects on surfaces of planar products10.1109/TII.2017.2668438 ↗
12. Zhang, J., Guo, Z., Jiao, T., and Wang, M. (2018). Defect detection of aluminum alloy wheels in radiography images using adaptive threshold and morphological reconstruction. Appl. Sci., 8.10.3390/app8122365 ↗
13. Large-complex-surface defect detection by hybrid gradient threshold segmentation and image registration10.1109/ACCESS.2018.2842028 ↗
14. Fang, X., Luo, Q., Zhou, B., Li, C., and Tian, L. (2020). Research progress of automated visual surface defect detection for industrial metal planar materials. Sensors, 20.10.3390/s20185136 ↗
15. 3D defect detection of connectors based on structured light10.1007/s11801-021-9212-8 ↗
16. Defect inspection for underwater structures based on line-structured light and binocular vision10.1364/AO.428502 ↗
17. Model-driven photometric stereo for in-process inspection of non-diffuse curved surfaces10.1016/j.cirp.2019.04.013 ↗
18. Wu, K., Tan, J., Li, J., and Liu, C. (2021). Few-Shot Learning Approach for 3D Defect Detection in Lithium Battery, IOP Publishing.10.1088/1742-6596/1884/1/012024 ↗
19. Gu, J., Zhang, Y., Yin, Y., Wang, R., Deng, J., and Zhang, B. (2022). Surface defect detection of cabbage based on curvature features of 3D point cloud. Front. Plant Sci., 13.10.3389/fpls.2022.942040 ↗
20. Optimization of the photometric stereo method for measuring pavement texture properties10.1016/j.measurement.2018.05.109 ↗
21. Huang, S., Xu, K., Li, M., and Wu, M. (2019). Improved visual inspection through 3D image reconstruction of defects based on the photometric stereo technique. Sensors, 19.10.3390/s19224970 ↗
22. A threshold selection method from gray-level histograms
23. Characteristic analysis of Otsu threshold and its applications10.1016/j.patrec.2011.01.021 ↗
24. Comparison of texture features based on Gabor filters10.1109/TIP.2002.804262 ↗
25. Performance evaluation for four classes of textural features10.1016/0031-3203(92)90036-I ↗
26. Texture analysis anno 198310.1016/0734-189X(85)90130-6 ↗
27. Photometric method for determining surface orientation from multiple images10.1117/12.7972479 ↗
28. Soukup, D., and Huber-Mörk, R. (2014, January 8–10). Convolutional Neural Networks for Steel Surface Defect Detection From Photometric Stereo Images. Proceedings of the International Symposium on Visual Computing, Las Vegas, NV, USA.10.1007/978-3-319-14249-4_64 ↗
29. Lee, J.H., Oh, H.M., and Kim, M.Y. (2019, January 11–13). Deep learning based 3D defect detection system using photometric stereo illumination. Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan.10.1109/ICAIIC.2019.8669005 ↗
30. Karami, A., Menna, F., and Remondino, F. (2022). Combining photogrammetry and photometric stereo to achieve precise and complete 3D reconstruction. Sensors, 22.10.3390/s22218172 ↗
31. Cao, Y., Ding, B., Chen, J., Liu, W., Guo, P., Huang, L., and Yang, J. (2022). Photometric-stereo-based defect detection system for metal parts. Sensors, 22.10.3390/s22218374 ↗
32. A review of recent advances in surface defect detection using texture analysis techniques10.5565/rev/elcvia.268 ↗
33. Automated fabric defect detection—A review10.1016/j.imavis.2011.02.002 ↗
34. The fourier transform10.1038/scientificamerican0689-86 ↗
35. Accuracy of the discrete Fourier transform and the fast Fourier transform10.1137/S1064827593247023 ↗
36. The fast Fourier transform10.1109/MSPEC.1967.5217220 ↗
37. Defect detection in textured materials using Gabor filters10.1109/28.993164 ↗
38. Optimal Gabor filters for textile flaw detection10.1016/S0031-3203(02)00017-1 ↗
39. Zhang, Q., Tang, H., Li, Y., Han, B., and Li, J. (2023). Improved Method Based on Retinex and Gabor for the Surface Defect Enhancement of Aluminum Strips. Metals, 13.10.3390/met13010118 ↗
40. Combining Gabor filter and FFT for fingerprint enhancement based on a regional adaption method and automatic segmentation10.1007/s11760-013-0436-3 ↗
41. Dakshayani, V., Locharla, G.R., Pławiak, P., Datti, V., and Karri, C. (2022). Design of a Gabor filter-based image denoising hardware model. Electronics, 11.10.3390/electronics11071063 ↗
42. Shaik, A., Sai, M.N.V.V.S., Supriya, A., Jaikesh, M., Amarendra, K., and Srinivas, P. (2023, January 3–5). Enhanced Texture Analysis to Detect Fabric Stain Using Deep Learning and Gabor Filter. Proceedings of the 2023 5th International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India.10.1109/ICIRCA57980.2023.10220732 ↗
43. Theory of communication. Part 1: The analysis of information
44. Automated surface inspection using Gabor filters10.1007/s001700070055 ↗
45. Zheng, J., Gao, Y., Zhang, H., Lei, Y., and Zhang, J. (2022). OTSU multi-threshold image segmentation based on improved particle swarm algorithm. Appl. Sci., 12.10.3390/app122211514 ↗
46. Molloy, T.L., Ford, J.J., and Mejias, L. (2017, January 13–16). Adaptive detection threshold selection for vision-based sense and avoid. Proceedings of the 2017 International Conference on Unmanned Aircraft Systems (ICUAS), Miami, FL, USA.10.1109/ICUAS.2017.7991313 ↗
47. A simple guidance template-based defect detection method for strip steel surfaces10.1109/TII.2018.2887145 ↗
48. Yang, F.-S., Ho, C.-C., and Chen, L.-C. (2021). Automated optical inspection system for o-ring based on photometric stereo and machine vision. Appl. Sci., 11.10.3390/app11062601 ↗
49. Podrekar, G., Tomaževič, D., Likar, B., and Usenik, P. (2017, January 8–12). Model based visual inspection of pharmaceutical tablets with photometric stereo. Proceedings of the 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA), Nagoya, Japan.10.23919/MVA.2017.7986819 ↗
50. Composite Structure Detection Method for Surface Scratches on Textured Paper based on Photometric Stereoscopic Imaging10.2352/J.ImagingSci.Technol.2024.68.3.030503 ↗