A Normalizing Flow-Based Bidirectional Mapping Residual Network for Unsupervised Defect Detection
Source abstract
Abstract
Unsupervised methods based on density representation have shown their abilities in anomaly detection, but detection performance still needs to be improved. Specifically, approaches using normalizing flows can accurately evaluate sample distributions, mapping normal features to the normal distribution and anomalous features outside it. Consequently, this paper proposes a Normalizing Flow-based Bidirectional Mapping Residual Network (NF-BMR). It utilizes pre-trained Convolutional Neural Networks (CNN) and normalizing flows to construct discriminative source and target domain feature spaces. Additionally, to better learn feature information in both domain spaces, we propose the Bidirectional Mapping Residual Network (BMR), which maps sample features to these two spaces for anomaly detection. The two detection spaces effectively complement each other’s deficiencies and provide a comprehensive feature evaluation from two perspectives, which leads to the improvement of detection performance. Comparative experimental results on the MVTec AD and DAGM datasets against the Bidirectional Pre-trained Feature Mapping Network (B-PFM) and other state-of-the-art methods demonstrate that the proposed approach achieves superior performance. On the MVTec AD dataset, NF-BMR achieves an average AUROC of 98.7% for all 15 categories. Especially, it achieves 100% optimal detection performance in five categories. On the DAGM dataset, the average AUROC across ten categories is 98.7%, which is very close to supervised methods.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Non-Destructive Testing Techniques · Welding Techniques and Residual Stresses
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. A graph model-based multiscale feature fitting method for unsupervised anomaly detection10.1016/j.patcog.2023.109373 ↗
2. Application of nanogenerators in the field of acoustics10.1021/acsaelm.3c00996 ↗
3. Sensing as the key to the safety and sustainability of new energy storage devices10.1186/s41601-023-00300-2 ↗
4. A. Bochkovskiy, C. Y. Wang and H. Y. M. Liao, “YOLOv4: Optimal speed and accuracy of object detection,” arXiv preprint arXiv:2004.10934, 2020.
5. C. Y. Wang, I. H. Yeh and H. Y. M. Liao, “You only learn one representation: Unified network for multiple tasks,” arXiv preprint arXiv:2105.04206, 2021.
6. TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios
7. Padim: A patch distribution modeling framework for anomaly detection and localization
8. N. Cohen and Y. Hoshen, “Sub-image anomaly detection with deep pyramid correspondences,” arXiv preprint arXiv:2005.02357, 2020.
9. Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional normalizing flows
10. Fully convolutional cross-scale-flows for image-based defect detection
11. Same same but differnet: Semi-supervised defect detection with normalizing flows
12. J. Yang, Y. Shi and Z. Qi, “DFR: Deep feature reconstruction for unsupervised anomaly segmentation,” arXiv preprint arXiv:2012.07122, 2020.
13. Unsupervised image anomaly detection and segmentation based on pretrained feature mapping10.1109/TII.2022.3182385 ↗
14. ADTR: Anomaly detection transformer with feature reconstruction
15. A multi-task network with weight decay skip connection training for anomaly detection in retinal fundus images
16. UTRAD: Anomaly detection and localization with U-transformer10.1016/j.neunet.2021.12.008 ↗
17. ImageNet: A large-scale hierarchical image database
18. Auto-encoding variational bayes
19. Ganomaly: Semi-supervised anomaly detection via adversarial training
20. f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks10.1016/j.media.2019.01.010 ↗
21. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs10.1109/TPAMI.2017.2699184 ↗
22. A semantically driven self-supervised algorithm for detecting anomalies in image sets10.1016/j.cviu.2021.103279 ↗
23. Learning semantic context from normal samples for unsupervised anomaly detection
24. Reconstruction by inpainting for visual anomaly detection10.1016/j.patcog.2020.107706 ↗
25. L. Dinh, J. Sohl-Dickstein and S. Bengio, “Density estimation using real NVP,” arXiv preprint arXiv:1605.08803, 2017.
26. MVTec AD–A comprehensive real-world dataset for unsupervised anomaly detection
27. Weakly supervised learning for industrial optical inspection
28. Efficientnet: Rethinking model scaling for convolutional neural networks
29. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
30. I. Golan and R. El-Yaniv, “Deep anomaly detection using geometric transformations,” arXiv preprint arXiv:1805.10917, 2018.
31. Attribute restoration framework for anomaly detection
32. Anomaly detection based on multi-teacher knowledge distillation10.1016/j.sysarc.2023.102861 ↗
33. Skip-ganomaly: Skip connected and adversarially trained encoder-decoder anomaly detection
34. M. Salehi, A. Eftekhar, N. Sadjadi, M. H. Rohban and H. R. Rabiee, “Puzzle-AE: Novelty detection in images through solving puzzles,” arXiv preprint arXiv:2008.12959, 2020.
35. CutPaste: Self-supervised learning for anomaly detection and localization
36. End-to-end training of a two-stage neural network for defect detection