journal article·2024Open access

Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things

Mengmeng Zhao, Haipeng Peng, Lixiang Li, Yeqing Ren

Computers, Materials & Continua· Volume 80· Issue 2

Abstract

In the Industrial Internet of Things (IIoT), sensors generate time series data to reflect the working state. When the systems are attacked, timely identification of outliers in time series is critical to ensure security. Although many anomaly detection methods have been proposed, the temporal correlation of the time series over the same sensor and the state (spatial) correlation between different sensors are rarely considered simultaneously in these methods. Owing to the superior capability of Transformer in learning time series features. This paper proposes a time series anomaly detection method based on a spatial-temporal network and an improved Transformer. Additionally, the methods based on graph neural networks typically include a graph structure learning module and an anomaly detection module, which are interdependent. However, in the initial phase of training, since neither of the modules has reached an optimal state, their performance may influence each other. This scenario makes the end-to-end training approach hard to effectively direct the learning trajectory of each module. This interdependence between the modules, coupled with the initial instability, may cause the model to find it hard to find the optimal solution during the training process, resulting in unsatisfactory results. We introduce an adaptive graph structure learning method to obtain the optimal model parameters and graph structure. Experiments on two publicly available datasets demonstrate that the proposed method attains higher anomaly detection results than other methods.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Time Series Analysis and Forecasting · Network Security and Intrusion Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (41)

Show source-provided references
1. Deep learning in the industrial internet of things: Potentials, challenges, and emerging applications10.1109/JIOT.2021.3051414 ↗
2. Bayesian fault detection and localization through wireless sensor networks in industrial plants10.1109/JIOT.2024.3359646 ↗
3. Anomaly detection using autoencoders with nonlinear dimensionality reduction
4. Deep autoencoding gaussian mixture model for unsupervised anomaly detection
5. P. Malhotra, A. Ramakrishnan, G. Anand, L. Vig, P. Agarwal, and G. Shroff, “LSTM-based encoder-decoder for multi-sensor anomaly detection,” arXiv preprint arXiv:1607.00148, 2016.
6. D. Li, D. Chen, J. Goh, and S. K. Ng, “Anomaly detection with generative adversarial networks for multivariate time series,” arXiv preprint arXiv:1809.04758, 2018.
7. MAD-GAN: Multivariate anomaly detection for time series data with generative adversarial networks
8. Robust anomaly detection for multivariate time series through stochastic recurrent neural network
9. A multimodal anomaly detector for robot-assisted feeding using an LSTM-based variational autoencoder10.1109/LRA.2018.2801475 ↗
10. Representation learning using a multi-branch transformer for industrial time series anomaly detection
11. S. Tuli, G. Casale, and N. R. Jennings, “TranAD: Deep transformer networks for anomaly detection in multivariate time series data,” arXiv preprint arXiv:2201.07284, 2022.10.14778/3514061.3514067 ↗
12. Y. Nie, N. H. Nguyen, P. Sinthong, and J. Kalagnanam, “A time series is worth 64 words: Long-term forecasting with transformers,” arXiv preprint arXiv:2211.14730, 2022.
13. DCdetector: Dual attention contrastive representation learning for time series anomaly detection
14. Graph neural network-based anomaly detection in multivariate time series
15. Deep variational graph convolutional recurrent network for multivariate time series anomaly detection
16. GRU-based interpretable multivariate time series anomaly detection in industrial control system10.1016/j.cose.2023.103094 ↗
17. Fast outlier detection in high dimensional spaces
18. A novel anomaly detection scheme based on principal component classifier
19. LOF: Identifying density-based local outliers
20. Network anomaly detection based on wavelet analysis
21. Wavelet based detection of outliers in volatility time series models
22. Estimating the support of a high-dimensional distribution10.1162/089976601750264965 ↗
23. Arima based network anomaly detection
24. A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data
25. Time series forecasting of petroleum production using deep LSTM recurrent networks10.1016/j.neucom.2018.09.082 ↗
26. Defect detection model using time series data augmentation and transformation
27. P. Filonov, A. Lavrentyev, and A. Vorontsov, “Multivariate industrial time series with cyber-attack simulation: Fault detection using an LSTM-based predictive data model,” arXiv preprint arXiv:1612.06676, 2016.
28. Detecting spacecraft anomalies using LSTMs and nonparametric dynamic thresholding
29. Anomaly detection in quasi-periodic time series based on automatic data segmentation and attentional LSTM-CNN10.1109/TKDE.2020.3014806 ↗
30. USAD: Unsupervised anomaly detection on multivariate time series
31. Adaptive memory networks with self-supervised learning for unsupervised anomaly detection10.1109/TKDE.2021.3139916 ↗
32. A. Dosovitskiy et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2010.
33. XLNet: Generalized autoregressive pretraining for language understanding
34. J. Xu, H. Wu, J. Wang, and M. Long, “Anomaly transformer: Time series anomaly detection with association discrepancy,” arXiv preprint arXiv:2110.02642, 2021.
35. Variational transformer-based anomaly detection approach for multivariate time series10.1016/j.measurement.2022.110791 ↗
36. Multiscale wavelet graph autoencoder for multivariate time-series anomaly detection
37. Learning graph structures with transformer for multivariate time-series anomaly detection in IoT10.1109/JIOT.2021.3100509 ↗
38. Multivariate time-series anomaly detection via graph attention network
39. Deep recurrent graph convolutional architecture for sensor fault detection, isolation and accommodation in digital twins10.1109/JSEN.2023.3326096 ↗
40. Learning hierarchical spatial-temporal graph representations for robust multivariate industrial anomaly detection10.1109/TII.2022.3216006 ↗
41. Aggarwal · The Data Mining · 2015 · 1 · 237