Research Progress of Visual Inspection Technology of Steel Products—A Review
Source abstract
Abstract
The automation and intellectualization of the manufacturing processes in the iron and steel industry needs the strong support of inspection technologies, which play an important role in the field of quality control. At present, visual inspection technology based on image processing has an absolute advantage because of its intuitive nature, convenience, and efficiency. A major breakthrough in this field can be achieved if sufficient research regarding visual inspection technologies is undertaken. Therefore, the purpose of this article is to study the latest developments in steel inspection relating to the detected object, system hardware, and system software, existing problems of current inspection technologies, and future research directions. The paper mainly focuses on the research status and trends of inspection technology. The network framework based on deep learning provides space for the development of end-to-end mode inspection technology, which would greatly promote the implementation of intelligent manufacturing.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Surface Roughness and Optical Measurements · Image Processing Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical Engineering, Jiangsu University, Zhenjiang 212013, China
School of Mechanical Engineering, Anyang Institute of Technology, Anyang 455000, China
Funding
National Natural Science Foundation of China
References (90)
Show source-provided references
1. Pinho, E., and Costa, C. (2018). Unsupervised learning for concept detection in medical images: A comparative analysis. Appl. Sci., 8.10.3390/app8081213 ↗
2. Kong, X., and Li, J. (2018). Image Registration-Based Bolt Loosening Detection of Steel Joints. Sensors, 18.10.3390/s18041000 ↗
3. Vision-Based Fatigue Crack Detection of Steel Structures Using Video Feature Tracking10.1111/mice.12353 ↗
4. Deep neural networks for document processing of music score images10.3390/app8050654 ↗
5. Development of real-time vision-based fabric inspection system10.1109/TIE.2005.851648 ↗
6. Vehicle bottom anomaly detection algorithm based on sift10.1016/j.ijleo.2015.08.268 ↗
7. Noncontact detection of ultrasonic waves using fiber optic sagnac interferometer10.1109/TUFFC.2002.1009334 ↗
8. Automated visual inspection: A survey10.1109/TPAMI.1982.4767309 ↗
9. A survey of automated visual inspection10.1006/cviu.1995.1017 ↗
10. Free-form surface inspection techniques state of the art review10.1016/j.cad.2004.02.009 ↗
11. Trends in automated visual inspection10.1007/s11554-006-0009-6 ↗
12. Fabric defect detection systems and methods—A systematic literature review10.1016/j.ijleo.2016.09.110 ↗
13. Applications of computer vision techniques in the agriculture and food industry: A review10.1007/s00217-012-1844-2 ↗
14. Dependences of the reflectivity and adhesion of thin metal films on the various process parameters for polyester substrates during physical vapor depositions10.1007/BF03178262 ↗
15. Review of vision-based steel surface inspection systems10.1186/1687-5281-2014-50 ↗
16. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
17. Yun, J.P., Choi, S.H., Jeon, Y., Choi, D., and Kim, S.W. (2008, January 14–17). Detection of line defects in steel billets using undecimated wavelet transform. Proceedings of the 2008 IEEE International Conference on Control, Automation and Systems, Seoul, Korea.10.1109/ICCAS.2008.4694506 ↗
18. Optimization of the recognition of defects in flat steel products with the cost matrices theory10.1016/S0963-8695(96)00045-X ↗
19. Defects detection of billet surface using optimized gabor filters10.3182/20080706-5-KR-1001.00012 ↗
20. Surface Detection of Continuous Casting Slabs Based on Curvelet Transform and Kernel Locality Preserving Projections10.1016/S1006-706X(13)60102-8 ↗
21. Steel defect classification with Max-Pooling Convolutional Neural Networks
22. A cost-effective and automatic surface defect inspection system for hot-rolled flat steel10.1016/j.rcim.2015.09.008 ↗
23. Genetic algorithm and mathematical morphology based binarization method for strip steel defect image with non-uniform illumination10.1016/j.jvcir.2015.04.005 ↗
24. Wu, X., Xu, K., and Xu, J. (2008, January 27–30). Application of Undecimated Wavelet Transform to Surface Defect Detection of Hot Rolled Steel Plates. Proceedings of the 2008 IEEE Conference on Image and Signal, Sanya, China.10.1109/CISP.2008.278 ↗
25. Wu, G., Kwak, H., Jang, S., Xu, K., and Xu, J. (2008, January 1–3). Design of online surface inspection system of hot rolled strips. Proceedings of the 2008 IEEE International Conference on Automation and Logistics, Qingdao, China.
26. Automatic defect detection on hot-rolled flat steel products10.1109/TIM.2012.2218677 ↗
27. Image Fusion Method for Strip Steel Surface Detect Based on Bandelet-PCNN10.4028/www.scientific.net/AMR.546-547.806 ↗
28. Caleb, P., and Steuer, M. (September, January 30). Classification of surface defects on hot rolled steel using adaptive learning methods. Proceedings of the International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, Brighton, UK.
29. Process knowledge based multi-class support vector classification (PK-MSVM) approach for surface defects in hot rolling10.1016/j.eswa.2010.12.026 ↗
30. Wu, G., Zhang, H., and Sun, X. (2007, January 18–21). A Bran-new Feature Extraction Method and its application to Surface Defect Recognition of Hot Rolled Strips. Proceedings of the IEEE International Conference on Automation and Logistics, Jinan, China.10.1109/ICAL.2007.4338916 ↗
31. Automated surface defect detection for cold-rolled steel strip based on wavelet anisotropic diffusion method
32. Image classification for steel strip surface defects based on support vector machines10.4028/www.scientific.net/AMR.217-218.336 ↗
33. Martins, L.A.O., PaáDua, F.L.C., and Almeida, P.E.M. (2010, January 7–10). Automatic detection of surface defects on rolled steel using Computer Vision and Artificial Neural Networks. Proceedings of the IECON 2010—36th Annual Conference on IEEE Industrial Electronics Society, Glendale, AZ, USA.10.1109/IECON.2010.5675519 ↗
34. Automatic surface inspection system for tin mill black plate (TMBP)
35. Development of defect detection algorithm in cold rolling
36. Zhao, J., Zhao, J., Yang, Y., and Li, G. (2010, January 1–2). The Cold Rolling Strip Surface Defect On-Line Inspection System Based on Machine Vision. Proceedings of the Second Pacific-Asia Conference on IEEE Circuits, Communications and System (PACCS), Beijing, China.10.1109/PACCS.2010.5626924 ↗
37. Wu, G.F. (2010). Online Surface Inspection Technology of Cold Rolled Strips, Multimedia, InTech.10.5772/7643 ↗
38. Application of a new feature extraction and optimization method to surface defect recognition of cold rolled strips
39. Peng, K., and Zhang, X. (2009, January 14–16). Classification Technology for Automatic Surface Defects Detection of Steel Strip Based on Improved BP Algorithm. Proceedings of the International Conference on Natural Computation IEEE, Tianjin, China.10.1109/ICNC.2009.487 ↗
40. An End-to-End Steel Strip Surface Defects Recognition System Based on Convolutional Neural Networks
41. Masci, J., Meier, U., Fricout, G., and Schmidhuber, J. (2013, January 4–9). Multi-scale pyramidal pooling network for generic steel defect classification. Proceedings of the International Joint Conference on Neural Networks, Dallas, TX, USA.10.1109/IJCNN.2013.6706920 ↗
42. Kang, G.W., and Liu, H.B. (2005, January 18–21). Surface defects inspection of cold rolled strips based on neural network. Proceedings of the International Conference on Machine Learning and Cybernetics IEEE, Guangzhou, China.
43. Choi, K., Koo, K., and Jin, S.L. (2006, January 18–21). Development of Defect Classification Algorithm for POSCO Rolling Strip Surface Inspection System. Proceedings of the International Joint Conference IEEE, SICE-ICASE, Busan, Korea.10.1109/SICE.2006.314681 ↗
44. Kaya, K., Bilgutay, N.M., and Murthy, R. (November, January 31). Flaw detection in stainless steel samples using wavelet decomposition. Proceedings of the 1994 IEEE Conference on Ultrasonics Symposium, Cannes, France.10.1109/ULTSYM.1994.401815 ↗
45. Real-time defects detection algorithm for high-speed steel bar in coil, world academy of science
46. Vision-based sensor for early detection of periodical defects in web materials10.3390/s120810788 ↗
47. A local annular contrast based real-time inspection algorithm for steel bar surface defects10.1016/j.apsusc.2012.03.007 ↗
48. Zhang, J., Kang, D., and Won, S. (2010, January 27–30). Detection of scratch defects for wire rod in steelmaking process. Proceedings of the 2010 IEEE International Conference on Control, Automation and Systems, Gyeonggi-do, Korea.10.1109/ICCAS.2010.5670210 ↗
49. Defect inspection system for steel wire rods produced by hot rolling process10.1007/s00170-013-5397-8 ↗
50. Algorithm for detecting seam cracks in steel plates using a gabor filter combination method10.1364/AO.53.004865 ↗
51. Koller, N., O’Leary, P., and Lee, P. (2004, January 3). Comparison of cmos and ccd cameras for laser profiling. Proceedings of the SPIE the International Society for Optical Engineering, San Jose, CA, USA.10.1117/12.529868 ↗
52. A real time object recognition and counting system for smart industrial camera sensor10.1109/JSEN.2017.2671457 ↗
53. Nguyen, A.Q., Vts, D., Shimonomura, K., Takehara, K., and Etoh, T.G. (2018). Toward the ultimate-high-speed image sensor: From 10 ns to 50 ps. Sensors, 18.10.3390/s18082407 ↗
54. A modified virtual point model of the 3d dic technique using a single camera and a bi-prism10.1088/0957-0233/25/11/115008 ↗
55. Automatic inspection of metallic surface defects using genetic algorithms10.1016/S0924-0136(02)00294-7 ↗
56. Texture classification by statistical learning from morphological image processing: Application to metallic surfaces10.1111/j.1365-2818.2010.03365.x ↗
57. Yun, J.P., Park, C., Bae, H., Hwang, H., and Choi, S. (2010, January 27–30). Vertical Scratch Detection Algorithm for High-speed Scale-covered Steel BIC (Bar in Coil). Proceedings of the 2010 IEEE International Conference on Control Automation and Systems, Gyeonggi-do, Korea.10.1109/ICCAS.2010.5670190 ↗
58. Statistical and structural approaches to texture10.1109/PROC.1979.11328 ↗
59. Liu, W., Yan, Y., Li, J., Zhang, Y., and Sun, H. (2008, January 20–22). Automated On-Line Fast Detection for Surface Defect of Steel Strip Based on Multivariate Discriminant Function. Proceedings of the 2008 IEEE Second International Symposium on Intelligent Information Technology Application, Computer Society, Shanghai, China.
60. Steel surface defects recognition based on multi-type statistical features and enhanced twin support vector machine10.1016/j.chemolab.2017.10.020 ↗
61. Study on Defection Segmentation for Steel Surface Image Based on Image Edge Detection and Fisher Discriminant10.1088/1742-6596/48/1/068 ↗
62. Tang, B., Kong, J.Y., Wang, X.D., and Chen, L. (2009, January 25–26). Surface Inspection System of Steel Strip Based on Machine Vision. Proceedings of the First International Workshop on Database Technology and Applications, Wuhan, China.10.1109/DBTA.2009.133 ↗
63. Yang, S.S., He, Y.H., Wang, Z.L., and Zhao, W.S. (2008, January 21–24). A method of steel strip image segmentation based on local gray information. Proceedings of the 2008 IEEE International Conference on Industrial Technology, Chengdu, China.10.1109/ICIT.2008.4608646 ↗
64. Strip Steel Defect Detection Based on Saliency Map Construction Using Gaussian Pyramid Decomposition10.2355/isijinternational.ISIJINT-2015-041 ↗
65. Liu, Y.C., Hsu, Y.L., Sun, Y.N., Tsai, S.J., Ho, C.Y., and Chen, C.M. (2010, January 15–17). A computer vision system for automatic steel surface inspection. Proceedings of the fifth IEEE conference on Industrial Electronics and Applications (ICIEA), Taichung, Taiwan.
66. Jeon, Y.J., Choi, S.H., and Yun, J.P. (2011, January 26–29). Detection of scratch defects on slab surface. Proceedings of the 1994 IEEE International Conference on Control, Automation and Systems, Gyeonggi-do, Korea.
67. Pinhole detection in steel slab images using gabor filter and morphological features10.1364/AO.50.005122 ↗
68. On-line seam detection in rolling processes using snake projection and discrete wavelet transform10.1115/1.2752519 ↗
69. Steel Strip Defect Detection based on Human Visual Attention Mechanism Model10.4028/www.scientific.net/AMM.530-531.456 ↗
70. Ridgelets: A key to higher-dimensional intermittency?10.1098/rsta.1999.0444 ↗
71. Claypoole, R.L., and Baraniuk, R.G. (2000, January 4). Multiresolution wedgelet transform for image processing. Proceedings of the SPIE—The International Society for Optical Engineering, San Diego, CA, USA.10.1117/12.408609 ↗
72. Beamlets and Multiscale Image Analysis10.1007/978-3-642-56205-1_3 ↗
73. Recovering edges in ill-posed inverse problems: Optimality of curvelet frames
74. Pennec, E.L., and Mallat, S. (2001, January 7–10). Bandelet representations for image compression. Proceedings of the 2001 IEEE International Conference on Image Processing, Thessaloniki, Greece.
75. Do, M.N., and Vetterli, M. (2002, January 22–25). Contourlets: A Directional Mulitresolution Image Representation. Proceedings of the 1994 IEEE International Conference on Image Processing, Rochester, NY, USA.
76. Application of RNAMlet to surface defect identification of steels10.1016/j.optlaseng.2018.01.010 ↗
77. Mandelbrot, B.B. (1983). The Fractal Geometry of Nature, W. H. Freeman.10.1119/1.13295 ↗
78. A Surface Inspection Machine Vision System that Includes Fractal Texture Analysis
79. Yazdchi, M., Yazdi, M., and Mahyari, A.G. (2009, January 7–9). Steel Surface Defect Detection Using Texture Segmentation Based on Multifractal Dimension. Proceedings of the International Conference on Digital Image Processing, Bangkok, Thailand.10.1109/ICDIP.2009.68 ↗
80. Ünsalan, C., and Erçil, A. (1999). Automated Inspection of Steel Structures, Recent Advances in Mechatronics, Springer Ltd.
81. An improved bp algorithm and its application in classification of surface defects of steel plate
82. Machine learning-based imaging system for surface defect inspection10.1007/s40684-016-0039-x ↗
83. Multi-class classification for steel surface defects based on machine learning with quantile hyper-spheres10.1016/j.chemolab.2017.07.008 ↗
84. Steel surface defect classification using multiple hyper-spheres support vector machine with additional information10.1016/j.chemolab.2017.11.018 ↗
85. Research on on-line surface defect detection for steel strip based on sparse coding10.4028/www.scientific.net/AMR.548.749 ↗
86. Yazdchi, M.R., Mahyari, A.G., and Nazeri, A. (2009, January 24). Detection and Classification of Surface Defects of Cold Rolling Mill Steel Using Morphology and Neural Network. Proceedings of the 2008 IEEE International Conference on Computational Intelligence for Modelling Control & Automation, Vienna, Austria.10.1109/CIMCA.2008.130 ↗
87. Defect detection of steel surfaces with global adaptive percentile thresholding of gradient image
88. Jia, H., Yi, L.M., Shi, J., and Chang, T.S. (2004, January 26). An Intelligent Real-time Vision System for Surface Defect Detection. Proceedings of the International Conference on Pattern Recognition IEEE, Cambridge, UK.
89. Web process inspection using neural classification of scattering light10.1109/41.222644 ↗
90. (2017, April 24). Global and China Machine Vision Industry Report. Available online: http://www.pday.com.cn/Htmls/Report/201704/24516162.html.