Unsupervised Anomaly Detection in Time Series Data via Enhanced VAE-Transformer Framework
Source abstract
Abstract
Time series anomaly detection is crucial in finance, healthcare, and industrial monitoring. However, traditional methods often face challenges when handling time series data, such as limited feature extraction capability, poor temporal dependency handling, and suboptimal real-time performance, sometimes even neglecting the temporal relationships between data. To address these issues and improve anomaly detection performance by better capturing temporal dependencies, we propose an unsupervised time series anomaly detection method, VLT-Anomaly. First, we enhance the Variational Autoencoder (VAE) module by redesigning its network structure to better suit anomaly detection through data reconstruction. We introduce hyperparameters to control the weight of the Kullback-Leibler (KL) divergence term in the Evidence Lower Bound (ELBO), thereby improving the encoder module’s decoupling and expressive power in the latent space, which yields more effective latent representations of the data. Next, we incorporate transformer and Long Short-Term Memory (LSTM) modules to estimate the long-term dependencies of the latent representations, capturing both forward and backward temporal relationships and performing time series forecasting. Finally, we compute the reconstruction error by averaging the predicted results and decoder reconstruction and detect anomalies through grid search for optimal threshold values. Experimental results demonstrate that the proposed method performs superior anomaly detection on multiple public time series datasets, effectively extracting complex time-related features and enabling efficient computation and real-time anomaly detection. It improves detection accuracy and robustness while reducing false positives and false negatives.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection · Time Series Analysis and Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (33)
Show source-provided references
1. Entropic dynamic time warping kernels for co-evolving financial time series analysis10.1109/TNNLS.2020.3006738 ↗
2. Automated financial time series anomaly detection via curiosity-guided exploration and self-imitation learning10.1016/j.engappai.2024.108663 ↗
3. Financial fraud: a review of anomaly detection techniques and recent advances10.1016/j.eswa.2021.116429 ↗
4. Anomaly detection in internet of medical things with blockchain from the perspective of deep neural network10.1016/j.ins.2022.10.060 ↗
5. Unsupervised brain imaging 3D anomaly detection and segmentation with transformers10.1016/j.media.2022.102475 ↗
6. Multi-layer parallel transformer model for detecting product quality issues and locating anomalies based on multiple time-series process data in Industry 4.010.1016/j.jmsy.2023.08.013 ↗
7. Machine learning-based anomaly detection of groundwater microdynamics: case study of Chengdu10.1038/s41598-023-38447-5 ↗
8. Varying-scale HCA-DBSCAN-based anomaly detection method for multi-dimensional energy data in steel industry10.1016/j.ins.2023.119479 ↗
9. Explainable time series anomaly detection using masked latent generative modeling10.1016/j.patcog.2024.110826 ↗
10. Unsupervised log anomaly detection method based on multi-feature
11. Unsupervised anomaly detection approach based on adversarial memory autoencoders for multivariate time series
12. Do deep neural networks contribute to multivariate time series anomaly detection?10.1016/j.patcog.2022.108945 ↗
13. Identifying outliers of non-Gaussian groundwater state data based on ensemble estimation for long-term trends10.1016/j.jhydrol.2017.02.058 ↗
14. Fast model update for iot traffic anomaly detection with machine unlearning10.1109/JIOT.2022.3214840 ↗
15. Anomaly detection for iot time-series data: a survey10.1109/JIOT.2019.2958185 ↗
16. Deep learning for anomaly detection in multivariate time series: approaches, applications, and challenges10.1016/j.inffus.2022.10.008 ↗
17. A survey on automated log analysis for reliability engineering10.1145/3460345 ↗
18. Advancing autoencoder architectures for enhanced anomaly detection in multivariate industrial time series
19. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
20. Learning phrase representations using RNN encoder-decoder for statistical machine translation
21. Deep learning for time series anomaly detection: a survey10.1145/3691338 ↗
22. Auto-encoding variational bayes
23. A review on outlier/anomaly detection in time series data10.1145/3444690 ↗
24. CausalVAE: disentangled representation learning via neural structural causal models
25. Score-VAE: root cause analysis for federated-learning-based IoT anomaly detection10.1109/JIOT.2023.3289814 ↗
26. Anomaly detection for time series using VAE-LSTM hybrid model
27. Semisupervised anomaly detection of multivariate time series based on a variational autoencoder
28. LSTM-GAN: unsupervised anomaly detection for time series fusion of GAN and Bi-LSTM
29. Anomaly VAE-transformer: a deep learning approach for anomaly detection in decentralized finance10.1109/ACCESS.2023.3313448 ↗
30. VAEAT: variational AutoeEncoder with adversarial training for multivariate time series anomaly detection10.1016/j.ins.2024.120852 ↗
31. Evaluating real-time anomaly detection algorithms—the Numenta anomaly benchmark
32. Unsupervised real-time anomaly detection for streaming data10.1016/j.neucom.2017.04.070 ↗
33. Anomaly detection and identification method for shield tunneling based on energy consumption perspective10.3390/app14052202 ↗