journal article·2023-11-24Open access

Enhancing Anomaly Detection Models for Industrial Applications through SVM-Based False Positive Classification

Ji Qiu, Hongmei Shi, Yuhen Hu, Zujun Yu

Applied Sciences· Volume 13· Issue 23

Abstract

Unsupervised anomaly detection models are crucial for the efficiency of industrial applications. However, frequent false alarms hinder the widespread adoption of unsupervised anomaly detection, especially in fault detection tasks. To this end, our research delves into the dependence of false alarms on the baseline anomaly detector by analyzing the high-response regions in anomaly maps. We introduce an SVM-based false positive classifier as a post-processing module, which identifies false alarms from positive predictions at the object level. Moreover, we devise a sample synthesis strategy that generates synthetic false positives from the trained baseline detector while producing synthetic defect patch features from fuzzy domain knowledge. Following comprehensive evaluations, we showcase substantial performance enhancements in two advanced out-of-distribution anomaly detection models, Cflow and Fastflow, across image and pixel-level anomaly detection performance metrics. Substantive improvements are observed in two distinct industrial applications, with notable instances of elevating the image-level F1-score from 46.15% to 78.26% in optimal scenarios and boosting pixel-level AUROC from 72.36% to 94.74%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection · COVID-19 diagnosis using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Advanced Rail Autonomous Operation/School of Mechanical and Electronic Control Engineering, Beijing Jiaotong University, Beijing 100044, China

College of Engineering, University of Wisconsin-Madison, Madison, WI 53705, USA

Frontiers Science Center for Smart High-Speed Railway System, Beijing 100044, China

Funding

Fundamental Research Funds for the Central Universities · State Key Laboratory of Advanced Rail Autonomous Operation · China Energy Investment Corporation

References (41)

Show source-provided references
1. Sharma, M., Lim, J., and Lee, H. (2022). The Amalgamation of the Object Detection and Semantic Segmentation for Steel Surface Defect Detection. Appl. Sci., 12.10.3390/app12126004 ↗
2. Luo, H., Cai, L., and Li, C. (2023). Rail Surface Defect Detection Based on An Improved YOLOv5s. Appl. Sci., 13.10.3390/app13127330 ↗
3. Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder with Multitask Learning10.1109/TIM.2018.2868490 ↗
4. Deep Anomaly Detection for Time-Series Data in Industrial IoT: A Communication-Efficient On-Device Federated Learning Approach10.1109/JIOT.2020.3011726 ↗
5. Sensors and AI Techniques for Situational Awareness in Autonomous Ships: A Review10.1109/TITS.2020.3023957 ↗
6. Efficient Anomaly Detection Using Self-Supervised Multi-Cue Tasks10.1109/TIP.2022.3231532 ↗
7. Data invariants to understand unsupervised out-of-distribution detection
8. Detecting out-of-distribution samples via variational auto-encoder with reliable uncertainty estimation10.1016/j.neunet.2021.10.020 ↗
9. A Unifying Review of Deep and Shallow Anomaly Detection10.1109/JPROC.2021.3052449 ↗
10. Change Detection in Image Time-Series Using Unsupervised LSTM
11. Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
12. Transferable network with Siamese architecture for anomaly detection in hyperspectral images
13. Wang, H., Zhang, A., Zhu, Y., Zheng, S., Li, M., Smola, A.J., and Wang, Z. (2022, January 17–23). Partial and Asymmetric Contrastive Learning for Out-Of-Distribution Detection in Long-Tailed Recognition. Proceedings of the 39th International Conference on Machine Learning, Baltimore, MD, USA.
14. Yu, J., Zheng, Y., Wang, X., Li, W., Wu, Y., Zhao, R., and Wu, L. (2021). Fastflow: Unsupervised anomaly detection and localization via 2d normalizing flows. arXiv.
15. Drost, B., Ulrich, M., Bergmann, P., Hartinger, P., and Steger, C. (2017, January 22–29). Introducing mvtec—A dataset for 3d object recognition in industry. Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy.10.1109/ICCVW.2017.257 ↗
16. Masked Swin Transformer Unet for Industrial Anomaly Detection10.1109/TII.2022.3199228 ↗
17. Time domain graph-based anomaly detection approach applied to a real industrial problem10.1016/j.compind.2022.103714 ↗
18. Integrated generative model for industrial anomaly detection via bidirectional lstm and attention mechanism10.1109/TII.2021.3078192 ↗
19. A hybrid one-class approach for detecting anomalies in industrial systems10.1111/exsy.12990 ↗
20. Evaluation of deep unsupervised anomaly detection methods with a data-centric approach for on-line inspection10.1016/j.compind.2023.103852 ↗
21. Yu, L., Wang, Y., Zhou, L., Wu, J., and Wang, Z. (2023). Residual neural network-assisted one-class classification algorithm for melanoma recognition with imbalanced data. Comput. Intell., 1–18.10.1111/coin.12578 ↗
22. Distributed system anomaly detection using deep learning-based log analysis10.1111/coin.12573 ↗
23. Kerboua, A., and Kelaiaia, R. (2023). Fault Diagnosis in an Asynchronous Motor Using Three-Dimensional Convolutional Neural Network. Arab. J. Sci. Eng., 1–19.10.1007/s13369-023-08025-y ↗
24. Anomaly Analysis in Images and Videos: A Comprehensive Review10.1145/3544014 ↗
25. Unsupervised industrial image ensemble anomaly detection based on object pseudo-anomaly generation and normal image feature combination enhancement10.1016/j.cie.2023.109337 ↗
26. Industrial uav-based unsupervised domain adaptive crack recognitions: From database towards real-site infrastructural in-spections10.1109/TIE.2022.3204953 ↗
27. Two-stage reverse knowledge distillation incorporated and Self-Supervised Masking strategy for industrial anomaly detection10.1016/j.knosys.2023.110611 ↗
28. Park, J.-H., Kim, Y.-S., Seo, H., and Cho, Y.-J. (2023). Analysis of training deep learning models for pcb defect detection. Sensors, 23.10.3390/s23052766 ↗
29. de Oliveira, D.C., Nassu, B.T., and Wehrmeister, M.A. (2023). Image-based detection of modifications in assembled pcbs with deep convolutional autoencoders. Sensors, 23.10.3390/s23031353 ↗
30. Smith, A.D., Du, S., and Kurien, A. (2023). Vision transformers for anomaly detection and localisation in leather surface defect classification based on low-resolution images and a small dataset. Appl. Sci., 13.10.3390/app13158716 ↗
31. Distilling distribution knowledge in normalizing flow10.1587/transinf.2022EDL8103 ↗
32. Adversarially robust one-class novelty detection
33. Gyimah, N.K., Gupta, K.D., Nabil, M., Yan, X., Girma, A., Homaifar, A., and Opoku, D. (2023, January 8–11). A discriminative deeplab model (ddlm) for surface anomaly detection and localization. Proceedings of the IEEE 13th Annual Computing and Communication Workshop and Conference, Las Vegas, NV, USA.10.1109/CCWC57344.2023.10099181 ↗
34. Extensive knowledge distillation model: An end-to-end effective anomaly detection model for real-time industrial applications10.1109/ACCESS.2023.3293108 ↗
35. Rudolph, M., Wehrbein, T., Rosenhahn, B., and Wandt, B. (2023, January 3–7). Asymmetric student-teacher networks for industrial anomaly detection. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV56688.2023.00262 ↗
36. Hermann, M., Umlauf, G., Goldlücke, B., and Franz, M.O. (2022). Fast and efficient image novelty detection based on mean-shifts. Sensors, 22.10.3390/s22197674 ↗
37. Real-time deep learning method for automated detection and localization of structural defects in manufactured products10.1016/j.cie.2022.108512 ↗
38. An unsupervised defect detection model for a dry carbon fiber textile10.1007/s10845-022-01964-7 ↗
39. Gudovskiy, D., Ishizaka, S., and Kozuka, K. (2022, January 3–8). Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional normalizing flows. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV51458.2022.00188 ↗
40. Rudolph, M., Wandt, B., and Rosenhahn, B. (2021, January 3–8). Same same but differnet: Semi-supervised defect detection with normalizing flows. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV48630.2021.00195 ↗
41. Rudolph, M., Wehrbein, T., Rosenhahn, B., and Wandt, B. (2022, January 4–8). Fully convolutional cross-scale-flows for image-based defect detection. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV51458.2022.00189 ↗