Hierarchical Spatial-Temporal Neural Network with Attention Mechanism for Traffic Flow Forecasting
Source abstract
Abstract
Accurate traffic flow forecasting is pivotal for intelligent traffic control and guidance. Manually capturing the intricate dependencies between spatial and temporal dimensions in traffic data presents a significant challenge. Prior methods have primarily employed Recurrent Neural Networks or Graph Convolutional Networks, without fully accounting for the interdependency between spatial and temporal factors. To address this, we introduce a novel Hierarchical Spatial-Temporal Neural Networks with Attention Mechanism model (HSTAN). This model concurrently captures temporal correlations and spatial dependencies using a multi-headed self-attention mechanism in both temporal and spatial terms. It also integrates global spatial-temporal correlations through a hierarchical structure with residuals. Moreover, the analysis of attention weight matrices can depict complex spatial-temporal correlations, thereby enhancing our traffic forecasting capabilities. We conducted experiments on two publicly available traffic datasets, and the results demonstrated that the HSTAN model’s prediction accuracy surpassed that of several benchmark methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Traffic Prediction and Management Techniques · Transportation Planning and Optimization · Traffic control and management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Merchant Ship, Shanghai Maritime University, Shanghai 201306, China
College of Information Engineering, Shanghai Maritime University, Shanghai 201306, China
References (30)
Show source-provided references
1. Deep Learning for Intelligent Transportation Systems: A Survey of Emerging Trends10.1109/TITS.2019.2929020 ↗
2. Graph Neural Network for Traffic Forecasting: A Survey10.1016/j.eswa.2022.117921 ↗
3. T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction10.1109/TITS.2019.2935152 ↗
4. Bai, J., Zhu, J., Song, Y., Zhao, L., Hou, Z., Du, R., and Li, H. (2021). A3T-GCN: Attention Temporal Graph Convolutional Network for Traffic Forecasting. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10070485 ↗
5. Xu, M., Dai, W., Liu, C., Gao, X., Lin, W., Qi, G.J., and Xiong, H. (2020). Spatial-Temporal Transformer Networks for Traffic Flow Forecasting. arXiv.
6. Feng, A., and Tassiulas, L. (2022, January 17–21). Adaptive Graph Spatial-Temporal Transformer Network for Traffic Flow Forecasting. Proceedings of the 31st ACM International Conference on Information and Knowledge Management (CIKM’22), New York, NY, USA.10.1145/3511808.3557540 ↗
7. Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. arXiv.
8. LSTM network: A deep learning approach for short-term traffic forecast10.1049/iet-its.2016.0208 ↗
9. Long short-term memory neural network for traffic speed prediction using remote microwave sensor data10.1016/j.trc.2015.03.014 ↗
10. Fu, R., Zhang, Z., and Li, L. (2016, January 11–13). Using LSTM and GRU neural network methods for traffic flow prediction. Proceedings of the 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC), Wuhan, China.10.1109/YAC.2016.7804912 ↗
11. Tran, Q.H., Fang, Y.-M., Chou, T.-Y., Hoang, T.-V., Wang, C.-T., Vu, V.T., Ho, T.L.H., Le, Q., and Chen, M.-H. (2022). Short-term traffic speed forecasting model for a parallel multi-lane arterial road using gps-monitored data based on deep learning approach. Sustainability, 14.10.3390/su14106351 ↗
12. Urban rail transit passenger flow forecast based on LSTM with enhanced long-term features10.1049/iet-its.2018.5511 ↗
13. Li, Y., Yu, R., Shahabi, C., and Liu, Y. (May, January 30). Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. Proceedings of the 6th International Conference on Learning Representations (ICLR’18), Vancouver, BC, Canada.
14. Yu, B., Yin, H., and Zhu, Z. (2018, January 13–19). Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI’18), Stockholm, Sweden.10.24963/ijcai.2018/505 ↗
15. Wu, Z., Pan, S., Long, G., Jiang, J., and Zhang, C. (2019, January 10–16). Graph wavenet for deep spatial-temporal graph modeling. Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI’19), Macao, China.10.24963/ijcai.2019/264 ↗
16. Multi-component spatial-temporal graph convolution networks for traffic flow forecasting
17. Spatial-temporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting
18. Bai, L., Yao, L., Li, C., Wang, X., and Wang, C. (2020). Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting. arXiv.
19. Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., and Zhang, C. (2020, January 6–10). Connecting the dots: Multivariate time series forecasting with graph neural networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event.10.1145/3394486.3403118 ↗
20. Velikovi, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., and Bengio, Y. (2017). Graph Attention Networks. arXiv.
21. Wu, T., Feng, C., and Yun, W. (2018, January 20–22). Graph Attention LSTM Network: A New Model for Traffic Flow Forecasting. Proceedings of the 5th International Conference on Information Science and Control Engineering (ICISCE’18), Zhengzhou, China.10.1109/ICISCE.2018.00058 ↗
22. Shih, S.Y., Sun, F.K., and Lee, H.Y. (2019). Temporal Pattern Attention for Multivariate Time Series Forecasting. arXiv.10.1007/s10994-019-05815-0 ↗
23. Fang, X., Huang, J., Wang, F., Zeng, L., and Wang, H. (2020, January 6–10). ConSTGAT: Contextual Spatial-Temporal Graph Attention Network for Travel Time Estimation at Baidu Maps. Proceedings of the 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD’20), Virtual Event.10.1145/3394486.3403320 ↗
24. Liu, C.H., Piao, C., Ma, X., Yuan, Y., and Leung, K.K. (2021, January 19–22). Modeling citywide crowd flows using attentive convolutional lstm. Proceedings of the IEEE 37th International Conference on Data Engineering (ICDE’21), Chania, Greece.10.1109/ICDE51399.2021.00026 ↗
25. Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting
26. Luo, X., Zhu, C., Zhang, D., and Li, Q. (2023). Dynamic Graph Convolution Network with Spatio-Temporal Attention Fusion for Traffic Flow Prediction. arXiv.
27. GMAN: A Graph Multi-Attention Network for Traffic Prediction
28. Learning Dynamics and Heterogeneity of Spatial-Temporal Graph Data for Traffic Forecasting10.1109/TKDE.2021.3056502 ↗
29. Learning Dynamic and Hierarchical Traffic Spatiotemporal Features With Transformer10.1109/TITS.2021.3102983 ↗
30. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.