Adaptive feature refinement with information preservation for multiclass unsupervised anomaly detection
Source abstract
Abstract
Recent advancements in anomaly detection have shown significant potential across various industrial domains. However, a wide range of unpredictable defect types emerge in the real world, and anomaly images are often challenging to obtain, making traditional methods less suitable. To address this challenge, recent studies have focused on the multiclass unsupervised anomaly detection task. Nonetheless, these approaches face significant challenges owing to the difficulty in robustly handling diverse classes and defect types. We propose adaptive feature refinement anomaly detection (AFRAD), which integrates a multilayer perceptron-based stage-adaptive decoder that adaptively decodes multiscale feature maps to model broader contextual relationships. Furthermore, to minimize information loss, we introduce a convolution neural network-based focused local decoder to capture fine details at low-level dimensions and an MLP-based compensation decoder. The compensation decoder compensates for information missed by the stage-adaptive decoder and focused local decoder. This strategy improves the ability of the model to handle diverse aspects of the data, enabling robust anomaly detection. In addition, we experimentally demonstrate that the fusion of final representations enables the generation of high-quality reconstructed feature maps. Our AFRAD achieves superior performance compared with conventional reconstruction-based methodologies on various public datasets.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Machine Learning and Data Classification · Imbalanced Data Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (32)
Show source-provided references
1. X. Ma, J. Keung, P. He, Y. Xiao, X. Yu, Y. Li, A semisupervised approach for industrial anomaly detection via self-adaptive clustering. IEEE Trans. Industr. Inf. 20(2), 1687–1697 (2023)10.1109/TII.2023.3280246 ↗
2. Y. Qiao, J. Lü, T. Wang, K. Liu, B. Zhang, H. Snoussi, A multihead attention self-supervised representation model for industrial sensors anomaly detection. IEEE Trans. Industr. Inf. 20(2), 2190–2199 (2023)10.1109/TII.2023.3280337 ↗
3. Q. Xu, T. Xie, C. Jiang, Q. Cheng, X. Wang, Adaptive working condition recognition with clustering-based contrastive learning for unsupervised anomaly detection. IEEE Trans. Industr. Inf. 20(10), 12103–12113 (2024)10.1109/TII.2024.3413952 ↗
4. P. Bergmann, M. Fauser, D. Sattlegger, C. Steger, Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4183–4192 (2020)10.1109/CVPR42600.2020.00424 ↗
5. J. Yi, S. Yoon, Patch svdd: patch-level svdd for anomaly detection and segmentation. In: Proceedings of the Asian Conference on Computer Vision (2020)10.1007/978-3-030-69544-6_23 ↗
6. C.-L. Li, K. Sohn, J. Yoon, T. Pfister, Cutpaste: Self-supervised learning for anomaly detection and localization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9664–9674 (2021)
7. V. Zavrtanik, M. Kristan, D. Skočaj, Draem-a discriminatively trained reconstruction embedding for surface anomaly detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 8330–8339 (2021)10.1109/ICCV48922.2021.00822 ↗
8. H. Deng, X. Li, Anomaly detection via reverse distillation from one-class embedding. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9737–9746 (2022)10.1109/CVPR52688.2022.00951 ↗
9. J.-W. Song, K. Kong, Y.-I. Park, S.-G. Kim, S.-J. Kang, Self-supervised anomaly segmentation for surface defect inspection in display panels. J. Soc. Inform. Display 33(11), 1059–1067 (2025)10.1002/jsid.2106 ↗
10. H. Shao, J. Peng, M. Shao, B. Liu, Multi-scale prototype fusion network for industrial product surface anomaly detection and localization. IEEE Sens. J. 24(20), 32707–32716 (2024)10.1109/JSEN.2024.3450749 ↗
11. K. Sohn, C.-L. Li, J. Yoon, M. Jin, T. Pfister, Learning and evaluating representations for deep one-class classification. arXiv:2011.02578 (2020)
12. G. Wang, S. Han, E. Ding, D. Huang, Student-teacher feature pyramid matching for anomaly detection. arXiv:2103.04257 (2021)10.5244/C.35.349 ↗
13. K. Roth, L. Pemula, J. Zepeda, B. Schölkopf, T. Brox, P. Gehler, Towards total recall in industrial anomaly detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 14318–14328 (2022)10.1109/CVPR52688.2022.01392 ↗
14. Z. Liu, Y. Zhou, Y. Xu, Z. Wang, Simplenet: A simple network for image anomaly detection and localization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 20402–20411 (2023)10.1109/CVPR52729.2023.01954 ↗
15. X. Zhang, S. Li, X. Li, P. Huang, J. Shan, T. Chen, Destseg: segmentation guided denoising student-teacher for anomaly detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 3914–3923 (2023)10.1109/CVPR52729.2023.00381 ↗
16. Y. Gao, Z. Han, J. Wang, Effd: an unsupervised surface defect detection method based on estimation and fusion of normal sample feature distribution. IEEE Sens. J. 25(1), 1104–1120 (2024)10.1109/JSEN.2024.3494772 ↗
17. Y. Yan, D. Wang, G. Zhou, Q. Chen, Unsupervised anomaly segmentation via multilevel image reconstruction and adaptive attention-level transition. IEEE Trans. Instrum. Meas. 70, 1–12 (2021)
18. W. Huang, Z. Liu, X. Jin, J. Xu, X. Yao, Improved autoencoder model with memory module for anomaly detection. IEEE Sens. J. 24(8), 12770–12781 (2024)10.1109/JSEN.2024.3370965 ↗
19. V. Zavrtanik, M. Kristan, D. Skočaj, Dsr-a dual subspace re-projection network for surface anomaly detection. In: European Conference on Computer Vision, pp. 539–554, Springer (2022)10.1007/978-3-031-19821-2_31 ↗
20. Z. You, K. Yang, W. Luo, L. Cui, Y. Zheng, X. Le, Adtr: anomaly detection transformer with feature reconstruction. In: International Conference on Neural Information Processing, pp. 298–310, Springer (2022)10.1007/978-3-031-30111-7_26 ↗
21. J. Pirnay, K. Chai, Inpainting transformer for anomaly detection. In: International Conference on Image Analysis and Processing, pp. 394–406. Springer (2022)10.1007/978-3-031-06430-2_33 ↗
22. Z. You, L. Cui, Y. Shen, K. Yang, X. Lu, Y. Zheng, X. Le, A unified model for multi-class anomaly detection. Adv. Neural. Inf. Process. Syst. 35, 4571–4584 (2022)10.52202/068431-0330 ↗
23. Y. Zhao, Omnial: A unified cnn framework for unsupervised anomaly localization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3924–3933, (2023)10.1109/CVPR52729.2023.00382 ↗
24. H. He, J. Zhang, H. Chen, X. Chen, Z. Li, X. Chen, Y. Wang, C. Wang, L. Xie, A diffusion-based framework for multi-class anomaly detection. In: Proc AAAI Conf Artif Intell 38, 8472–8480 (2024)10.1609/aaai.v38i8.28690 ↗
25. M.-H. Guo, C.-Z. Lu, Q. Hou, Z. Liu, M.-M. Cheng, S.-M. Hu, Segnext: rethinking convolutional attention design for semantic segmentation. Adv. Neural. Inf. Process. Syst. 35, 1140–1156 (2022)10.52202/068431-0084 ↗
26. P. Bergmann, M. Fauser, D. Sattlegger, C. Steger, Mvtec ad-a comprehensive real-world dataset for unsupervised anomaly detection. In: Proc IEEE/CVF Conf Comput Vis Pattern Recogn, pp. 9592–9600 (2019)10.1109/CVPR.2019.00982 ↗
27. Y. Zou, J. Jeong, L. Pemula, D. Zhang, O. Dabeer, Spot-the-difference self-supervised pre-training for anomaly detection and segmentation. In: European Conference on Computer Vision, pp. 392–408 (2022) Springer10.1007/978-3-031-20056-4_23 ↗
28. A. Krizhevsky, G. Hinton, et al. Learning multiple layers of features from tiny images (2009)
29. T. Defard, A. Setkov, A. Loesch, R. Audigier, Padim: a patch distribution modeling framework for anomaly detection and localization. In: International Conference on Pattern Recognition, pp. 475–489 Springer (2021)10.1007/978-3-030-68799-1_35 ↗
30. M. Salehi, N. Sadjadi, S. Baselizadeh, M.H. Rohban, H.R. Rabiee, Multiresolution knowledge distillation for anomaly detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14902–14912 (2021)10.1109/CVPR46437.2021.01466 ↗
31. P. Liznerski, L. Ruff, R.A. Vandermeulen, B.J. Franks, M. Kloft, K.-R. Müller, Explainable deep one-class classification. arXiv:2007.01760 (2020)
32. Reiss, T., Cohen, N., Bergman, L., Hoshen, Y.: Panda: adapting pretrained features for anomaly detection and segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2806–2814 (2021)10.1109/CVPR46437.2021.00283 ↗