A Prediction-Based Anomaly Detection Method for Traffic Flow Data with Multi-Domain Feature Extraction
Source abstract
Abstract
The core idea of prediction-based anomaly detection is to identify anomalies by constructing a prediction model and comparing predicted and observed values. However, most existing traffic flow prediction models primarily focus on spatio-temporal features, neglecting comprehensive frequency-domain feature learning. Additionally, anomaly detection accuracy is often limited by insufficient prediction error analysis. To address this limitation, this paper proposes a prediction-based anomaly detection method for traffic flow data with multi-domain feature extraction. The prediction model is built as follows: first, Bidirectional Long Short-Term Memory network (Bi-LSTM) and a Graph Attention Network (GAT) extract temporal and spatial features, respectively. Then, Fast Fourier Transform (FFT) converts time-domain signals into the frequency domain, where Transformer learns magnitude and phase features. Finally, a prediction model is constructed using the extracted time-domain and frequency-domain features. For error analysis, this paper innovatively applies Chebyshev’s inequality to determine the error threshold, identifying anomalies based on whether errors exceed this threshold. Experimental results show that integrating multi-domain features can more comprehensively capture data characteristics and improve model prediction accuracy. In the anomaly detection experiment, it was verified that constructing a high-accuracy prediction model and conducting reasonable error analysis can effectively enable anomaly detection in the data.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection · Time Series Analysis and Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Transportation Engineering, Kunming University of Science and Technology, Kunming 650500, China
Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
Funding
National Natural Science Foundation of China
References (36)
Show source-provided references
1. Alqahtani, A., Ali, M., Xie, X., and Jones, M.W. (2021). Deep Time-Series Clustering: A Review. Electronics, 10.10.3390/electronics10233001 ↗
2. Transfer learning-based nonstationary traffic flow prediction using AdaRNN and DCORAL10.1016/j.eswa.2024.125143 ↗
3. Comprehensive analysis of change-point dynamics detection in time series data: A review10.1016/j.eswa.2024.123342 ↗
4. Traffic Anomaly Detection based on Spatio-Temporal Hypergraph Convolution Neural Networks10.1016/j.physa.2024.129891 ↗
5. Wang, X., Fan, J., Yan, F., Hu, H., Zeng, Z., Wu, P., Huang, H., and Zhang, H. (2024). Unsupervised Anomaly Detection via Normal Feature-Enhanced Reverse Teacher–Student Distillation. Electronics, 13.10.3390/electronics13204125 ↗
6. Feature Bagging with Nested Rotations (FBNR) for anomaly detection in multivariate time series10.1016/j.future.2024.107545 ↗
7. DTAAD: Dual Tcn-attention networks for anomaly detection in multivariate time series data10.1016/j.knosys.2024.111849 ↗
8. Anomaly detection for multivariate time series in IoT using discrete wavelet decomposition and dual graph attention networks10.1016/j.cose.2024.104075 ↗
9. Robust generalized PCA for enhancing discriminability and recoverability10.1016/j.neunet.2024.106814 ↗
10. The impact of improved PCA method based on anomaly detection on chiller sensor fault detection10.1016/j.ijrefrig.2023.09.002 ↗
11. Discriminative dictionary learning for nonnegative representation based classification10.1016/j.eswa.2024.123998 ↗
12. Rashidi, M., Tashakori, S., Kalhori, H., Bahmanpour, M., and Li, B. (2023). Iterative-Based Impact Force Identification on a Bridge Concrete Deck. Sensors, 23.10.3390/s23229257 ↗
13. Deep learning enhanced principal component analysis for structural health monitoring10.1177/14759217211041684 ↗
14. CSiamese: A novel semi-supervised anomaly detection framework for gas turbines via reconstruction similarity10.1007/s00521-023-08507-y ↗
15. Anomaly detection model of mooring system based on LSTM PCA method10.1016/j.oceaneng.2022.111350 ↗
16. Aziz, Z., and Bestak, R. (2024). Insight into Anomaly Detection and Prediction and Mobile Network Security Enhancement Leveraging K-Means Clustering on Call Detail Records. Sensors, 24.10.3390/s24061716 ↗
17. Rajeshkumar, C., Soundar, K.R., Muthuselvi, R., and Kumar, R.R. (2025). UTO-LAB model: USRP based touchless lung anomaly detection model with optimized machine learning classifier. Biomed. Signal Process. Control., 99.10.1016/j.bspc.2024.106823 ↗
18. Wang, D., Nie, M., and Chen, D. (2023). BAE: Anomaly Detection Algorithm Based on Clustering and Autoencoder. Mathematics, 11.10.3390/math11153398 ↗
19. Exploring deep learning-based content-based video retrieval with Hierarchical Navigable Small World index and ResNet-50 features for anomaly detection10.1016/j.eswa.2024.123197 ↗
20. Time series forecasting and anomaly detection using deep learning10.1016/j.compchemeng.2023.108560 ↗
21. Shafeiy, E.E., Alsabaan, M., Ibrahem, M.I., and Elwahsh, H. (2023). Real-Time Anomaly Detection for Water Quality Sensor Monitoring Based on Multivariate Deep Learning Technique. Sensors, 23.10.3390/s23208613 ↗
22. Changzhi, L., Dandan, L., Mao, W., Hanlin, W., and Shuai, X. (2023). Detection of Outliers in Time Series Power Data Based on Prediction Errors. Energies, 16.10.3390/en16020582 ↗
23. Seasonal threshold to reduce false positives for prediction-based outlier detection in building energy data10.1016/j.jobe.2024.108539 ↗
24. Kidu, T., Song, Y., Seo, K.W., Lee, S., and Park, T. (2024). An Intelligent Real-Time Driver Activity Recognition System Using Spatio-Temporal Features. Appl. Sci., 14.10.3390/app14177985 ↗
25. Ullah, S., Ullah, N., Siddique, M.F., Ahmad, Z., and Kim, J.M. (2024). Spatio-Temporal Feature Extraction for Pipeline Leak Detection in Smart Cities Using Acoustic Emission Signals: A One-Dimensional Hybrid Convolutional Neural Network–Long Short-Term Memory Approach. Appl. Sci., 14.10.3390/app142210339 ↗
26. Tipper, S., Atlam, H.F., and Lallie, H.S. (2024). An Investigation into the Utilisation of CNN with LSTM for Video Deepfake Detection. Appl. Sci., 14.10.3390/app14219754 ↗
27. Xiong, J., Sun, Y., Sun, J., Wan, Y., and Yu, G. (2024). Sparse Temporal Data-Driven SSA-CNN-LSTM-Based Fault Prediction of Electromechanical Equipment in Rail Transit Stations. Appl. Sci., 14.10.3390/app14188156 ↗
28. Li, S., Sun, Y., and Wang, P. (2024). Prediction of PM2.5 Concentration on the Basis of Multitemporal Spatial Scale Fusion. Appl. Sci., 14.10.3390/app14167152 ↗
29. Faulty feeder detection for single phase-to-ground faults in distribution networks based on patch-to-patch CNN and feeder-to-feeder LSTM10.1016/j.ijepes.2022.108909 ↗
30. Analysis of single vehicle noise emissions in the frequency domain for two different motorizations10.1016/j.jenvman.2024.122905 ↗
31. GNSS spoofing detection based on frequency domain processing10.1016/j.measurement.2024.115872 ↗
32. Abbass, M.J., Lis, R., and Rebizant, W. (2024). A Predictive Model Using Long Short-Time Memory (LSTM) Technique for Power System Voltage Stability. Appl. Sci., 14.10.3390/app14167279 ↗
33. Wang, Z., Lu, T., Han, Y., Zhang, C., Zeng, X., and Li, W. (2024). Improving Ship Fuel Consumption and Carbon Intensity Prediction Accuracy Based on a Long Short-Term Memory Model with Self-Attention Mechanism. Appl. Sci., 14.10.3390/app14188526 ↗
34. Zhangming, X., Daofei, Z., Dafang, L., Shujing, H., and Luo, Z. (2022). Anomaly Detection of Metallurgical Energy Data Based on iForest-AE. Appl. Sci., 12.10.3390/app12199977 ↗
35. A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder10.1109/LRA.2018.2801475 ↗
36. Hundman, K., Constantinou, V., Laporte, C., Colwell, I., and Soderstrom, T. (2018, January 19–23). Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding. Proceedings of the Knowledge Discovery & Data Mining.10.1145/3219819.3219845 ↗