Complex Background Reconstruction for Novelty Detection
Source abstract
Abstract
Novelty detection aims to detect samples from classes different from the training samples (i.e., the normal class). Existing approaches predominantly make the target reconstruction better and choose the appropriate reconstruction error measurement method but ignore the influence of background information on this process. This paper proposes a novel reconstruction network and mutual information Siamese network. The reconstructed network aims to make the distribution of reconstructed samples consistent with that of original samples, intending to reduce background interference in the reconstruction process. After this, we measure the distance between the original and generated images based on a mutual information Siamese network, which extracts more discriminative features to calculate the similarity between the original images and their reconstructed ones. This part of the network uses global context information to improve the detection accuracy. We conduct extreme experiments to evaluate the proposed solution on two challenging public datasets. The experimental results show that the proposed method significantly outperforms the state-of-the-art methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Data-Driven Disease Surveillance · Artificial Immune Systems Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
The School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an 710049, China
Beijing Institute of Tracking and Telecommunication Technology, Beijing 100094, China
The School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, China
Funding
NSFC
References (43)
Show source-provided references
1. Sabokrou, M., Khalooei, M., Fathy, M., and Adeli, E. (2018, January 18–23). Adversarially Learned One-Class Classifier for Novelty Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00356 ↗
2. Schlegl, T., Seeböck, P., Waldstein, S.M., Schmidt-Erfurth, U., and Langs, G. (2017, January 25–30). Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. Proceedings of the International Conference on Information Processing in Medical Imaging, Boone, NC, USA.10.1007/978-3-319-59050-9_12 ↗
3. GAN-based anomaly detection: A review10.1016/j.neucom.2021.12.093 ↗
4. Javaid, A., Niyaz, Q., Sun, W., and Alam, M. (2016, January 3–5). A deep learning approach for network intrusion detection system. Proceedings of the 9th EAI International Conference on Bio-Inspired Information and Communications Technologies (formerly BIONETICS), New York, NY, USA.10.4108/eai.3-12-2015.2262516 ↗
5. Deep learning in bioinformatics
6. Isolation-based anomaly detection using nearest-neighbor ensembles10.1111/coin.12156 ↗
7. Ellouze, A., Ksantini, M., Delmotte, F., and Karray, M. (2018, January 19–22). Single Object Tracking Applied to an Aircraft. Proceedings of the 2018 15th International Multi-Conference on Systems, Signals & Devices (SSD), Yasmine Hammamet, Tunisia.10.1109/SSD.2018.8570663 ↗
8. Triki, N., Ksantini, M., and Karray, M. (2021, January 4–6). Traffic Sign Recognition System based on Belief Functions Theory. Proceedings of the 13th International Conference on Agents and Artificial Intelligence (ICAART 2021), Online.10.5220/0010239807750780 ↗
9. Yerima, S.Y., and Bashar, A. (2022, January 1–3). Semi-supervised novelty detection with one class SVM for SMS spam detection. Proceedings of the 2022 29th International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, Sofia, Bulgaria.10.1109/IWSSIP55020.2022.9854496 ↗
10. Almohsen, R., Keaton, M.R., Adjeroh, D.A., and Doretto, G. (2022, January 19–23). Generative probabilistic novelty detection with isometric adversarial autoencoders. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00218 ↗
11. Li, C.L., Chang, W.C., Cheng, Y., Yang, Y., and Póczos, B. (2017, January 4–9). Mmd gan: Towards deeper understanding of moment matching network. Proceedings of the Thirty-First Conference on Neural Information Processing Systems NIPS 2017, Advances in Neural Information Processing Systems, Long Beach, CA, USA.
12. Estimating the support of a high-dimensional distribution10.1162/089976601750264965 ↗
13. Kernel PCA for novelty detection10.1016/j.patcog.2006.07.009 ↗
14. Sakurada, M., and Yairi, T. (2014, January 2). Anomaly detection using autoencoders with nonlinear dimensionality reduction. Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis, Gold Coast, QLD, Australia.10.1145/2689746.2689747 ↗
15. Novelty detection in continuously changing environments10.1016/j.future.2020.07.037 ↗
16. Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, S.A., Binder, A., Müller, E., and Kloft, M. (2018, January 10–15). Deep one-class classification. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
17. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative adversarial nets. Proceedings of the 28th Annual Conference on Neural Information Processing Systems (2014NIPS), Advances in Neural Information Processing Systems, Red Hook, NY, USA.
18. Deecke, L., Vandermeulen, R., Ruff, L., Mandt, S., and Kloft, M. (2018). Anomaly detection with generative adversarial networks. arXiv.10.1007/978-3-030-10925-7_1 ↗
19. Augmented time regularized generative adversarial network (atr-gan) for data augmentation in online process anomaly detection10.1109/TASE.2021.3118635 ↗
20. NM-GAN: Noise-modulated generative adversarial network for video anomaly detection10.1016/j.patcog.2021.107969 ↗
21. Schölkopf, B., Smola, A.J., and Bach, F. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.10.7551/mitpress/4175.001.0001 ↗
22. Li, Y., Swersky, K., and Zemel, R. (2015, January 6–11). Generative moment matching networks. Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
23. Dziugaite, G.K., Roy, D.M., and Ghahramani, Z. (2015). Training generative neural networks via maximum mean discrepancy optimization. arXiv.
24. Chopra, S., Hadsell, R., and LeCun, Y. (2005, January 20–25). Learning a similarity metric discriminatively, with application to face verification. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
25. Hadsell, R., Chopra, S., and LeCun, Y. (2006, January 17–22). Dimensionality reduction by learning an invariant mapping. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06) IEEE, , New York, NY, USA.
26. Hoffer, E., and Ailon, N. (2015, January 12–14). Deep metric learning using triplet network. Proceedings of the International Workshop on Similarity-Based Pattern Recognition, Copenhagen, Denmark.10.1007/978-3-319-24261-3_7 ↗
27. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
28. Perera, P., Nallapati, R., and Xiang, B. (2019, January 15–20). Ocgan: One-class novelty detection using gans with constrained latent representations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00301 ↗
29. Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016, January 5–10). Improved techniques for training gans. Proceedings of the 30th Annual Conference on Neural Information Processing Systems, Advances in Neural Information Processing Systems, Barcelona, Spain.
30. Strictly proper scoring rules, prediction, and estimation10.1198/016214506000001437 ↗
31. Hjelm, R.D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Trischler, A., and Bengio, Y. (2018). Learning deep representations by mutual information estimation and maximization. arXiv.
32. Huber, P.J. (2011). Robust Statistics, Springer.10.1007/978-3-642-04898-2_594 ↗
33. Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features From Tiny Images, Citeseer. Technical Report.
34. Griffin, G., Holub, A., and Perona, P. (2007). Caltech-256 Object Category Dataset, California Institute of Technology.
35. You, C., Robinson, D.P., and Vidal, R. (2017, January 21–26). Provable self-representation based outlier detection in a union of subspaces. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.460 ↗
36. On estimation of a probability density function and mode10.1214/aoms/1177704472 ↗
37. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
38. Coherence pursuit: Fast, simple, and robust principal component analysis10.1109/TSP.2017.2749215 ↗
39. Xu, H., Caramanis, C., and Sanghavi, S. (2010, January 6–9). Robust PCA via outlier pursuit. Proceedings of the 24th Annual Conference on Neural Information Processing Systems, Advances in Neural Information Processing Systems 23 (NIPS 2010), Vancouver, BC, Canada.
40. Robust computation of linear models by convex relaxation10.1007/s10208-014-9221-0 ↗
41. Tsakiris, M.C., and Vidal, R. (2015, January 7–13). Dual principal component pursuit. Proceedings of the IEEE International Conference on Computer Vision Workshops, Santiago, Chile.10.1109/ICCVW.2015.114 ↗
42. Liu, G., Lin, Z., and Yu, Y. (2010, January 21–24). Robust subspace segmentation by low-rank representation. Proceedings of the roceedings of the 27th International Conference on Machine Learning, Haifa, Israel.
43. Moonesignhe, H., and Tan, P.N. (2006, January 13–15). Outlier detection using random walks. Proceedings of the 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI’06), Arlington, VA, USA.10.1109/ICTAI.2006.94 ↗