Low-Resolution Steel Surface Defects Classification Network Based on Autocorrelation Semantic Enhancement
Source abstract
Abstract
Aiming at the problems of low-resolution steel surface defects imaging, such as defect type confusion, feature blurring, and low classification accuracy, this paper proposes an autocorrelation semantic enhancement network (ASENet) for the classification of steel surface defects. It mainly consists of a backbone network and an autocorrelation semantic enhancement module (ASE), in which the autocorrelation semantic enhancement module consists of three main learnable modules: the CS attention module, the autocorrelation computation module, and the contextual feature awareness module. Specifically, we first use the backbone network to extract the basic features of the image and then use the designed CS attention module to enhance the basic features. In addition, to capture different aspects of semantic objects, we use the autocorrelation module to compute the correlation between neighborhoods and contextualize the basic and augmented features to enhance the recognizability of the features. Experimental results show that our method produces significant results, and the classification accuracy reaches 96.24% on the NEU-CLS-64 dataset. Compared with ViT-B/16, Swin_t, ResNet50, Mobilenet_v3_small, Densenet121, Efficientnet_b2, and baseline, the accuracy is 9.43%, 5.15%, 4.87%, 3.34%, 3.28%, 3.01%, and 2.72% higher, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Infrastructure Maintenance and Monitoring · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Techanical and Electrical Engineering Department, Shanxi Institute of Energy, Taiyuan 030600, China
College of Mechanical Engineering, North University of China, Taiyuan 030000, China
Funding
Shanxi Key RD Program
References (48)
Show source-provided references
1. The use of stainless steel in structures10.1002/pse.190 ↗
2. Wen, X., Shan, J., He, Y., and Song, K. (2022). Steel surface defect recognition: A survey. Coatings, 13.10.3390/coatings13010017 ↗
3. Multi-class classification for steel surface defects based on machine learning with quantile hyper-spheres10.1016/j.chemolab.2017.07.008 ↗
4. Machine learning-based imaging system for surface defect inspection10.1007/s40684-016-0039-x ↗
5. Review of surface defect detection of steel products based on machine vision10.1049/ipr2.12647 ↗
6. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 8–22). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
7. Cai, Z., and Vasconcelos, N. (2018, January 18–23). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗
8. Tian, Z., Shen, C., Chen, H., and He, T. (November, January 27). Fcos: Fully convolutional one-stage object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
9. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). Efficientdet: Scalable and efficient object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
10. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
11. Doersch, C. (2016). Tutorial on variational autoencoders. arXiv.
12. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
13. A new impulse detector for switching median filters10.1109/LSP.2002.805310 ↗
14. Wu, X.y., Xu, K., and Xu, J.w. (2008, January 27–30). Application of Undecimated Wavelet Transform to Surface Defect Detection of Hot Rolled Steel Plates. Proceedings of the 2008 Congress on Image and Signal Processing, Sanya, China.10.1109/CISP.2008.278 ↗
15. Senthikumar, M., Palanisamy, V., and Jaya, J. (2014, January 8). Metal surface defect detection using iterative thresholding technique. Proceedings of the Second International Conference on Current Trends In Engineering and Technology—ICCTET 2014, Coimbatore, India.10.1109/ICCTET.2014.6966360 ↗
16. Vision-based surface defect inspection for thick steel plates10.1117/1.OE.56.5.053108 ↗
17. Aghdam, S.R., Amid, E., and Imani, M.F. (2012, January 18–20). A fast method of steel surface defect detection using decision trees applied to LBP based features. Proceedings of the 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA), Singapore.10.1109/ICIEA.2012.6360951 ↗
18. Jian, L., Wei, H., and Bin, H. (2010, January 25–27). Research on inspection and classification of leather surface defects based on neural network and decision tree. Proceedings of the 2010 International Conference On Computer Design and Applications, Qinhuangdao, China.
19. Multiscale morphological segmentation of gray-scale images10.1109/TIP.2003.810757 ↗
20. Application of image processing methods for the characterization of selected features and wear analysis in surface topography measurements10.1016/j.promfg.2021.06.018 ↗
21. Image-based inspection technique of a machined metal surface for an unmanned lapping process10.1007/s40684-019-00181-7 ↗
22. Li, Z., Wu, C., Han, Q., Hou, M., Chen, G., and Weng, T. (2022). CASI-Net: A novel and effect steel surface defect classification method based on coordinate attention and self-interaction mechanism. Mathematics, 10.10.3390/math10060963 ↗
23. Hao, Z., Li, Z., Ren, F., Lv, S., and Ni, H. (2022). Strip steel surface defects classification based on generative adversarial network and attention mechanism. Metals, 12.10.3390/met12020311 ↗
24. Surface Defect Classification of Steel Strip with Few Samples Based on Dual-Stream Neural Network10.1002/srin.202100554 ↗
25. Li, S., Wu, C., and Xiong, N. (2022). Hybrid architecture based on CNN and transformer for strip steel surface defect classification. Electronics, 11.10.3390/electronics11081200 ↗
26. Bello, I., Zoph, B., Vaswani, A., Shlens, J., and Le, Q.V. (November, January 27). Attention augmented convolutional networks. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
27. Hu, D. (2020, January 3–4). An introductory survey on attention mechanisms in NLP problems. Proceedings of the Intelligent Systems and Applications: Proceedings of the 2019 Intelligent Systems Conference (IntelliSys), London, UK.10.1007/978-3-030-29513-4_31 ↗
28. Fukui, H., Hirakawa, T., Yamashita, T., and Fujiyoshi, H. (2019, January 15–20). Attention branch network: Learning of attention mechanism for visual explanation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01096 ↗
29. Attention mechanisms in computer vision: A survey10.1007/s41095-022-0271-y ↗
30. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
31. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
32. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
33. Rocco, I., Cimpoi, M., Arandjelović, R., Torii, A., Pajdla, T., and Sivic, J. (2018). Neighbourhood consensus networks. Adv. Neural Inf. Process. Syst., 31.
34. Hassani, A., Walton, S., Li, J., Li, S., and Shi, H. (2023, January 18–22). Neighborhood attention transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00599 ↗
35. Kang, D., Kwon, H., Min, J., and Cho, M. (2021, January 10–17). Relational embedding for few-shot classification. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00870 ↗
36. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
37. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
38. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
39. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
40. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
41. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning. PMLR, Long Beach, CA, USA.
42. Misra, D., Nalamada, T., Arasanipalai, A.U., and Hou, Q. (2021, January 5–9). Rotate to attend: Convolutional triplet attention module. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Virtual Conference.10.1109/WACV48630.2021.00318 ↗
43. Zhang, Q.L., and Yang, Y.B. (2021, January 6–11). SA-Net: Shuffle Attention for Deep Convolutional Neural Networks. Proceedings of the ICASSP 2021—2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414568 ↗
44. Liu, H., Liu, F., Fan, X., and Huang, D. (2021). Polarized self-attention: Towards high-quality pixel-wise regression. arXiv.10.1016/j.neucom.2022.07.054 ↗
45. Coatnet: Marrying convolution and attention for all data sizes
46. Mehta, S., and Rastegari, M. (2022). Separable self-attention for mobile vision transformers. arXiv.
47. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
48. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗