SD-INPFormer: an unsupervised anomaly detection model for steel surface defect
Source abstract
Abstract
Accurate detection of steel-surface defects is essential for industrial quality control. However, scarcity of defective samples, pronounced morphological variability, and prohibitive annotation costs severely limit the performance of conventional supervised approaches. To address this limitation, we propose SD-INPFormer, an unsupervised anomaly detection model built upon an enhanced INPFormer architecture. By dynamically extracting intrinsic normal prototypes (INPs) from each test image, the model entirely circumvents the need for external annotations. Specifically, we propose an adaptive weighted multi-scale feature fusion mechanism that preserves defect-related cues across all encoder scales. We introduce the MambaMixer module to suppress background texture noise and to amplify subtle defect responses. A MemoryMLP is further proposed to prevent the encoding of anomalous features, while multi-scale gated cross attention is employed to extract INPs at multiple scales. In addition, we devise multi-centre prototype attention to encompass diverse defect patterns. SD-INPFormer’s excellent performance is empirically validated on the SteelAD and SeverstalAD datasets, providing a high-precision solution for automated steel-surface quality inspection. The implementation is publicly available at https://github.com/ghlerrix/SD-INPformer.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Industrial Vision Systems and Defect Detection · Infrastructure Maintenance and Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
University of Science and Technology Liaoning
Funding
Natural Science Foundation of Liaoning Province · Basic Scientific Research Project of Education Department of Liaoning Province · Graduate Science and Technology Innovation Program of University of Science and Technology Liaoning
References (38)
Show source-provided references
1. Chazhoor AAP, Ho ESL, Gao B, et al. A review and benchmark on state-of-the-art steel defects detection. SN Comput Sci. 2024;5(1):1–14.
2. 10.1049/ipr2.1264710.1049/ipr2.12647 ↗
3. 10.1080/10589759.2025.251255310.1080/10589759.2025.2512553 ↗
4. 10.1080/10589759.2025.256678710.1080/10589759.2025.2566787 ↗
5. 10.1080/10589759.2024.240844110.1080/10589759.2024.2408441 ↗
6. 10.1109/TIM.2019.291540410.1109/TIM.2019.2915404 ↗
7. Yeung C-C, Lam K-M. Efficient fused-attention model for steel surface defect detection. IEEE Trans Instrum Meas. 2022;71:1–11.
8. 10.1016/j.measurement.2024.11439810.1016/j.measurement.2024.114398 ↗
9. 10.1109/TASE.2024.345782910.1109/TASE.2024.3457829 ↗
10. Huang X, Li Y, Bao Y, et al. Adaptive cross transformer with contrastive learning for surface defect detection. IEEE Trans Instrum Meas. 2024;73:1–17.10.1109/TIM.2024.3470998 ↗
11. 10.1109/TIM.2024.349272810.1109/TIM.2024.3492728 ↗
12. 10.1016/j.optlaseng.2019.01.01110.1016/j.optlaseng.2019.01.011 ↗
13. Wang H, Li Z, Wang H. Few-shot steel surface defect detection. IEEE Trans Instrum Meas. 2022;71:1–12.
14. 10.1145/342262210.1145/3422622 ↗
15. Defard T, Setkov A, Loesch A, et al. PaDiM: a patch distribution modeling framework for anomaly detection and localization. In: Del Bimbo A, Cucchiara R, Sclaroff S, Farinella GM, Mei T, Bertini M, Escalante HJ Vezzani R, editors. Pattern recognition. ICPR international workshops and challenges. Cham: Springer; 2021. p. 475–489.10.1007/978-3-030-68799-1_35 ↗
16. Roth K, Pemula L, Zepeda J, et al. Towards total recall in industrial anomaly detection. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) ;New Orleans, LA, USA; 2022. p. 14298–14308.10.1109/CVPR52688.2022.01392 ↗
17. Li C-L, Sohn K, Yoon J, et al. Cutpaste: self-supervised learning for anomaly detection and localization. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); Nashville, TN, USA; 2021. p. 9659–9669.
18. Wang G Han S Ding E et al. Student-teacher feature pyramid matching for anomaly detection. arXiv (2021).10.5244/C.35.349 ↗
19. Luo W, Cao Y, Yao H, et al. Exploring intrinsic normal prototypes within a single image for universal anomaly detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition ;Nashville, TN, USA; 2025. p. 9974–9983.
20. Dosovitskiy A Beyer L Kolesnikov A et al. An image is worth 16x16 words: transformers for image recognition at scale. arXiv. 2021.
21. Oquab M Darcet T Moutakanni T et al. Dinov2: learning robust visual features without supervision. arXiv. 2024.
22. Gu A, Dao T. Mamba: linear-time sequence modeling with selective state spaces. arxiv Prepr arxiv. 2023;2312:00752. Available from: https://arxiv.org/abs/2312.00752arXiv:2312.00752
23. Zhu L Liao B Zhang Q et al. Vision mamba: efficient visual representation learning with bidirectional state space model. 2024.
24. Liu Y, Tian Y, Zhao Y, et al. Vmamba: visual state space model. Adv Neural Inf Process Syst. 2024;37:103031–103063.
25. 10.1109/ICCV.2019.0017910.1109/ICCV.2019.00179 ↗
26. Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Adv Neural Inf Process Syst. 2017;30: 6000–6010.
27. Hendrycks D Gimpel K. Gaussian error linear units (GELUs). arXiv. 2023.
28. 10.1016/j.neunet.2017.12.01210.1016/j.neunet.2017.12.012 ↗
29. Grishin A. BorisV, iBardintsev, inversion. Oleg: Severstal: Steel Defect Detection; 2019.
30. Guo J, Lu S, Zhang W, et al. Dinomaly: the less is more philosophy in multi-class unsupervised anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Nashville, TN, USA; 2025. p. 20405–20415.
31. He H, Bai Y, Zhang J, et al. MambaAD: exploring state space models for multi-class unsupervised anomaly detection. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. NIPS ‘24; Red Hook, (NY), USA. Curran Associates Inc; 2025. Vol. 37. p. 71162–71187.
32. Rudolph M, Wehrbein T, Rosenhahn B, et al. Fully convolutional cross-scale-flows for image-based defect detection. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision ;Waikoloa, HI, USA; 2022. p. 1088–1097.
33. Zavrtanik V, Kristan M, Skočaj D. DRAEM - a discriminatively trained reconstruction embedding for surface anomaly detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision; Montreal, Canada; 2021. p. 8330–8339.
34. Zhang J Wang C Li X et al. Learning feature inversion for multi-class anomaly detection under general-purpose COCO-AD benchmark. arXiv preprint arXiv:2404.10760. 2024.
35. Deng H, Li X. Anomaly detection via reverse distillation from one-class embedding. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); New Orleans, LA, USA; 2022. p. 9727–9736.10.1109/CVPR52688.2022.00951 ↗
36. Tien TD, Nguyen AT, Tran NH, et al. Revisiting reverse distillation for anomaly detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); Vancouver, Canada; 2023. p. 24511–24520.
37. Hu Y, Yang J, Chen L, et al. Planning-oriented autonomous driving. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Vancouver, Canada; 2023. p. 17853–17862.
38. Lei J, Hu X, Wang Y, et al. PyramidFlow: high-resolution defect contrastive localization using pyramid normalizing flow. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Vancouver, Canada; 2023. p. 14143–14152.