Multivariate Time Series Anomaly Detection Using Working Memory Connections in Bi-Directional Long Short-Term Memory Autoencoder Network
Source abstract
Abstract
“Normal” events are characterized as data patterns or behaviors that align with expected operational conditions, while “anomalies” are defined as deviations from these patterns, potentially signaling faults, errors, or unexpected system behaviors. The timely and accurate detection of anomalies plays a critical role in domains such as industrial manufacturing, financial transactions, and other related domains. In the context of Industry 4.0, the proliferation of sensors has resulted in a massive influx of time series data, making the anomaly detection of such multivariate time series data a popular research area. Long Short-Term Memory (LSTM) has been extensively recognized as an effective framework for modeling and processing time series data. Previous studies have combined Bi-directional Long Short-Term Memory (Bi-LSTM) architecture with Autoencoder (AE) for multivariate time series anomaly detection. However, due to the inherent limitations of LSTM, Bi-LSTM-AE still cannot overcome these drawbacks. Our study replaces the LSTM units within the Bi-LSTM-AE architecture of existing research with Working Memory Connections for LSTM units and demonstrates that this architecture performs better in the field of multivariate time series anomaly detection compared to using standard LSTM units. The model we proposed not only outperforms the baseline models but also demonstrates greater robustness across various scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Time Series Analysis and Forecasting · Network Security and Intrusion Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Business Administration, School of Business, Dongguk University-Seoul, Seoul 04620, Republic of Korea
Funding
Dongguk University Research Fund
References (31)
Show source-provided references
1. Anomaly detection: A survey10.1145/1541880.1541882 ↗
2. Said Elsayed, M., Le-Khac, N.A., Dev, S., and Jurcut, A.D. (2020, January 16–20). Network anomaly detection using LSTM based autoencoder. Proceedings of the 16th ACM Symposium on QoS and Security for Wireless and Mobile Networks, Alicante, Spain.10.1145/3416013.3426457 ↗
3. Real-time big data processing for anomaly detection: A survey10.1016/j.ijinfomgt.2018.08.006 ↗
4. Economic quality control of manufactured product 110.1002/j.1538-7305.1930.tb00373.x ↗
5. Procedures for detecting outlying observations in samples10.1080/00401706.1969.10490657 ↗
6. Surace, C., Worden, K., and Tomlinson, G. (August, January 30). A novelty detection approach to diagnose damage in a cracked beam. Proceedings of the Proceedings-SPIE The International Society For Optical Engineering. Citeseer, San Diego, CA, USA.
7. Detection of outlying data in bioavailability/bioequivalence studies10.1002/sim.4780100906 ↗
8. An anomaly detection technique based on a chi-square statistic for detecting intrusions into information systems10.1002/qre.392 ↗
9. A comprehensive survey of anomaly detection algorithms
10. Distance-based outliers: Algorithms and applications10.1007/s007780050006 ↗
11. Breunig, M.M., Kriegel, H.P., Ng, R.T., and Sander, J. (2000, January 16–18). LOF: Identifying density-based local outliers. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335388 ↗
12. Kernel PCA and de-noising in feature spaces
13. Sheridan, K., Puranik, T.G., Mangortey, E., Pinon-Fischer, O.J., Kirby, M., and Mavris, D.N. (2020, January 6–10). An application of dbscan clustering for flight anomaly detection during the approach phase. Proceedings of the AIAA Scitech 2020 Forum, Orlando, FL, USA.10.2514/6.2020-1851 ↗
14. Deep learning for time series anomaly detection: A survey
15. Variational autoencoder based anomaly detection using reconstruction probability
16. Lee, S., Jin, H., Nengroo, S.H., Doh, Y., Lee, C., Heo, T., and Har, D. (2022, January 7–9). Smart metering system capable of anomaly detection by bi-directional LSTM autoencoder. Proceedings of the 2022 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.10.1109/ICCE53296.2022.9730398 ↗
17. Cho, K. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv.10.3115/v1/D14-1179 ↗
18. Feature extraction using an RNN autoencoder for skeleton-based abnormal gait recognition10.1109/ACCESS.2020.2967845 ↗
19. A multimodal anomaly detector for robot-assisted feeding using an lstm-based variational autoencoder10.1109/LRA.2018.2801475 ↗
20. Raihan, A.S., and Ahmed, I. (2023, January 26–30). A Bi-LSTM Autoencoder Framework for Anomaly Detection-A Case Study of a Wind Power Dataset. Proceedings of the 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), Auckland, New Zealand.10.1109/CASE56687.2023.10260331 ↗
21. Gers, F.A., and Schmidhuber, J. (2000, January 27). Recurrent nets that time and count. Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks, IJCNN 2000, Neural Computing: New Challenges and Perspectives for the New Millennium, Como, Italy.10.1109/IJCNN.2000.861302 ↗
22. Working memory connections for LSTM10.1016/j.neunet.2021.08.030 ↗
23. Jeong, Y., Yang, E., Ryu, J.H., Park, I., and Kang, M. (2023). Anomalybert: Self-supervised transformer for time series anomaly detection using data degradation scheme. arXiv.
24. Yang, Y., Zhang, C., Zhou, T., Wen, Q., and Sun, L. (2023, January 6–10). Dcdetector: Dual attention contrastive representation learning for time series anomaly detection. Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Long Beach, CA, USA.10.1145/3580305.3599295 ↗
25. Calibrated one-class classification for unsupervised time series anomaly detection10.1109/TKDE.2024.3393996 ↗
26. Do autoencoders need a bottleneck for anomaly detection?10.1109/ACCESS.2022.3192134 ↗
27. Hochreiter, S. (1997). Long Short-term Memory. Neural Computation, MIT-Press.10.1162/neco.1997.9.8.1735 ↗
28. Unidirectional and bidirectional LSTM models for short-term traffic prediction10.1155/2021/5589075 ↗
29. LSTM-autoencoder-based anomaly detection for indoor air quality time-series data10.1109/JSEN.2022.3230361 ↗
30. Katser, I.D., and Kozitsin, V.O. (2025, March 01). Skoltech Anomaly Benchmark (skab). Kaggle 2020. Available online: https://github.com/waico/SKAB.
31. Hundman, K., Constantinou, V., Laporte, C., Colwell, I., and Soderstrom, T. (2018, January 19–23). Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.10.1145/3219819.3219845 ↗