journal article·2026-06-01

KD-ADSeg: dual-stage knowledge distillation with segmentation-guided asymmetric denoising for industrial anomaly detection

Liwei Deng, Longyu Jia, Tian Zhou

Publisher page

Abstract

Anomaly detection in industrial production is critical for ensuring product quality and operational safety. However, anomalous images often exhibit multi-scale structures, fine-grained details, and blurred boundaries, which challenge existing methods in localization accuracy and boundary delineation. To address these issues, this paper proposes a Dual-Stage Knowledge Distillation with Segmentation-Guided Asymmetric Denoising framework for Industrial Anomaly Detection (KD-ADSeg), aiming to enhance discriminative ability for anomalous regions and improve separation and localization under complex backgrounds. Specifically, an Asymmetric Denoising Student Network (ADSNet) is introduced and trained on synthetically generated anomalous images to suppress background noise. In addition, a Residual Local Importance-Aware Block (ResLIA-Block) is designed to integrate local attention with multi-scale residual aggregation, improving feature representation for segmentation. Furthermore, a Context-Aware Multi-path Propagation (CAMP) module is proposed to enhance contextual modeling and improve detection of blurred boundaries and large-scale defects through multi-scale feature fusion. Extensive experiments on the Real-IAD dataset show that KD-ADSeg achieves significant improvements in both pixel-level and image-level anomaly detection, demonstrating its effectiveness in industrial inspection. Its generalization ability is further validated on the MVTec AD, 3CAD, and VisA datasets.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Fault Detection and Control Systems · Machine Fault Diagnosis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Harbin University of Science and Technology

Funding

Key R&D Program Guidance Projects of Heilongjiang Province

References (54)

Show source-provided references
1. 10.1080/10589759.2024.235533410.1080/10589759.2024.2355334 ↗
2. 10.1007/s10462-025-11287-710.1007/s10462-025-11287-7 ↗
3. 10.1016/j.media.2022.10247510.1016/j.media.2022.102475 ↗
4. Watanabe H, Togo R, Ogawa T, et al. Bone metastatic tumor detection based on AnoGAN using CT images[C]. In: 2019 IEEE 1st global conference on life sciences and technologies (LifeTech); Osaka, Japan. 2019. p. 235–236.10.1109/LifeTech.2019.8883999 ↗
5. Bao Q, Wang J, Gong H, et al. A deep learning approach to anomaly detection in high-frequency trading data[c]. In: 2025 4th International Symposium on Computer Applications and Information Technology (ISCAIT); Xi’an, China. 2025. p. 287–291.10.1109/ISCAIT64916.2025.11010680 ↗
6. Tang T, Yao J, Wang Y, et al. Application of deep generative models for anomaly detection in complex financial transactions[C]. In: 2025 4th International Conference on Artificial Intelligence, Internet and Digital Economy (ICAID); Guangzhou, China. 2025. p. 133–137.10.1109/ICAID65275.2025.11034573 ↗
7. 10.1016/j.cviu.2018.02.00610.1016/j.cviu.2018.02.006 ↗
8. Roth K, Pemula L, Zepeda J, et al. Towards total recall in industrial anomaly detection[C]. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; New Orleans, Louisiana, USA. 2022. p. 14318–14328.
9. 10.1080/10589759.2025.257784010.1080/10589759.2025.2577840 ↗
10. Zaheer MZ, Lee J-H, Astrid M, et al. Old is gold: redefining the adversarially learned one-class classifier training paradigm[C]. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Seattle, Washington, USA. 2020. p. 14183–14193.
11. Bergmann P Löwe S Fauser M et al. Improving unsupervised defect segmentation by applying structural similarity to autoencoders. arXiv preprint arXiv:180702011 2018.10.5220/0007364503720380 ↗
12. Goodfellow IJ, Pouget-Abadie J, Mirza M, et al. Generative adversarial nets. Adv Neural Inf Process Syst. 2014;27:1–9.
13. 10.1109/TIM.2025.355185210.1109/TIM.2025.3551852 ↗
14. 10.1109/TII.2025.356849910.1109/TII.2025.3568499 ↗
15. 10.1038/nature1453910.1038/nature14539 ↗
16. Gu Z, Liu L, Chen X, et al. Remembering normality: memory-guided knowledge distillation for unsupervised anomaly detection[C]. In: Proceedings of the IEEE/CVF International Conference on Computer Vision; Paris, France. Vol. 2023. p. 16401–16409.
17. Zhang X, Li S, Li X, et al. Destseg: segmentation guided denoising student-teacher for anomaly detection[c]. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Vancouver, Canada. 2023. p. 3914–3923.
18. Vasilev A, Golkov V, Meissner M, et al. Q-space novelty detection with variational autoencoders[C]. In: Computational Diffusion MRI: MICCAI Workshop, Shenzhen, China, October 2019; Shenzhen, China. 2020. p. 113–124.10.1007/978-3-030-52893-5_10 ↗
19. Thomas S, Philipp S, Sebastian MW, et al. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery[c]. In: International conference on information processing in medical imaging; Hong Kong, China. 2017. p. 146–157.
20. 10.1016/j.media.2019.01.01010.1016/j.media.2019.01.010 ↗
21. Akcay S, Atapour-Abarghouei A, Breckon TP. Ganomaly: semi-supervised anomaly detection via adversarial training[C]. In: Asian conference on computer vision; Perth, Australia. 2018. p. 622–637.
22. Defard T, Setkov A, Loesch A, et al. Padim: a patch distribution modeling framework for anomaly detection and localization[C]. In: International conference on pattern recognition; Milano, Italy. Vol. 2021. p. 475–489.
23. Rudolph M, Wehrbein T, Rosenhahn B, et al. Fully convolutional cross-scale-flows for image-based defect detection[C]. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision; Waikoloa, Hawaii, USA. Vol. 2022. p. 1088–1097.
24. Jiang X, Liu J, Wang J, et al. Softpatch: unsupervised anomaly detection with noisy data. Adv Neural Inf Process Syst. 2022;35:15433–15445.10.52202/068431-1123 ↗
25. You Z, Cui L, Shen Y, et al. A unified model for multi-class anomaly detection. Adv Neural Inf Process Syst. 2022;35:4571–4584.
26. Bergmann P, Fauser M, Sattlegger D, et al. Uninformed students: student-teacher anomaly detection with discriminative latent embeddings[c]. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Seattle, Washington, USA. 2020. p. 4183–4192.
27. 10.1016/j.eswa.2025.12824910.1016/j.eswa.2025.128249 ↗
28. 10.1016/j.knosys.2023.11061110.1016/j.knosys.2023.110611 ↗
29. 10.1016/j.cviu.2024.10407410.1016/j.cviu.2024.104074 ↗
30. 10.1109/TIM.2025.355157110.1109/TIM.2025.3551571 ↗
31. 10.1109/TIM.2024.350703610.1109/TIM.2024.3507036 ↗
32. He Y, Yang H, Yin Z. Adaptive context-aware distillation for industrial image anomaly detection. IEEE Trans Instrum Meas. 2023;73:1–15.
33. 10.1109/TIM.2023.333022210.1109/TIM.2023.3330222 ↗
34. Lan L Cai P Jiang L et al. Brau-net++: u-shaped hybrid CNN-transformer network for medical image segmentation. arXiv preprint arXiv:240100722 2024.
35. He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]. In: Proceedings of the IEEE conference on computer vision and pattern recognition; Las Vegas, Nevada, USA. 2016. p. 770–778.
36. Wang Y, Li Y, Wang G, et al. PlainUSR: chasing faster ConvNet for efficient super-resolution[C]. In: Proceedings of the Asian Conference on Computer Vision; Chiang Mai, Thailand. Vol. 2024. p. 4262–4279.
37. 10.1109/TPAMI.2017.269918410.1109/TPAMI.2017.2699184 ↗
38. 10.1109/TCSVT.2024.350950410.1109/TCSVT.2024.3509504 ↗
39. Lin T-Y, Goyal P, Girshick R, et al. Focal loss for dense object detection[c]. In: Proceedings of the IEEE international conference on computer vision; Venice, Italy. Vol. 2017. p. 2980–2988.
40. Cimpoi M, Maji S, Kokkinos I, et al. Describing textures in the wild[c]. In: Proceedings of the IEEE conference on computer vision and pattern recognition; Columbus, Ohio, USA. 2014. p. 3606–3613.
41. Wang C, Zhu W, Gao B-B, et al. Real-iad: a real-world multi-view dataset for benchmarking versatile industrial anomaly detection[C]. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; Seattle, Washington, USA. 2024. p. 22883–22892.
42. 10.1007/s11263-020-01400-410.1007/s11263-020-01400-4 ↗
43. Zou Y, Jeong J, Pemula L, et al. Spot-the-difference self-supervised pre-training for anomaly detection and segmentation[C]. In: European conference on computer vision; Tel Aviv, Israel. Vol. 2022. p. 392–408.
44. Yang E, Xing P, Sun H, et al. 3cad: a large-scale real-world 3c product dataset for unsupervised anomaly detection[c]. In: Proceedings of the AAAI conference on artificial intelligence; Philadelphia, Pennsylvania, USA. 2025. p. 9175–9183.
45. 10.1007/s00371-024-03412-410.1007/s00371-024-03412-4 ↗
46. 10.1109/TBDATA.2024.335053910.1109/TBDATA.2024.3350539 ↗
47. He H, Zhang J, Chen H, et al. A diffusion-based framework for multi-class anomaly detection[C]. In: Proceedings of the AAAI conference on artificial intelligence; Vancouver, British Columbia, Canada. 2024. p. 8472–8480.
48. Yu J Zheng Y Wang X et al. Fastflow: unsupervised anomaly detection and localization via 2d normalizing flows. arXiv preprint arXiv:07677 2021.
49. Zavrtanik V, Kristan M, Skočaj D. Draem-a discriminatively trained reconstruction embedding for surface anomaly detection[C]. In: Proceedings of the IEEE/CVF international conference on computer vision; Montreal, Quebec, Canada. Vol. 2021. p. 8330–8339.
50. Zhang X, Xu M, Zhou X. Realnet: a feature selection network with realistic synthetic anomaly for anomaly detection[C]. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Seattle, Washington, USA. 2024. p. 16699–16708.
51. Lee JC, Kim T, Park E, et al. Continuous memory representation for anomaly detection[C]. In: European conference on computer vision; Milan, Italy. 2024. p. 438–454.
52. 10.1109/TPAMI.2022.316408310.1109/TPAMI.2022.3164083 ↗
53. 10.1109/TIP.2024.335410810.1109/TIP.2024.3354108 ↗
54. Liu Z, Zhou Y, Xu Y, et al. Simplenet: a simple network for image anomaly detection and localization[C]. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition; Vancouver, British Columbia, Canada. 2023. p. 20402–20411.