Short-Term and Long-Term Travel Time Prediction Using Transformer-Based Techniques
Source abstract
Abstract
In the evolving field of Intelligent Transportation Systems (ITSs), accurate and reliable traffic prediction is essential in enhancing management and planning capabilities. Accurately predicting traffic conditions over both short-term and long-term intervals is vital for the practical application of ITS. The integration of deep learning into traffic prediction has proven crucial in advancing traffic prediction beyond traditional approaches, particularly in analyzing and forecasting complex traffic scenarios. Despite these advancements, the existing methods are unable to effectively handle both short-term and long-term traffic patterns given their complex nature, revealing a need for more comprehensive forecasting solutions. To address this need, we propose a new approach named the Short-Term and Long-Term Integrated Transformer (SLIT). SLIT is a Transformer-based encoder–decoder architecture, designed for the effective prediction of both short-term and long-term travel time durations. The architecture integrates the Enhanced Data Preprocessing (EDP) with the Short-Term and Long-Term Integrated Encoder–Decoder (SLIED). This harmonious combination enables SLIT to effectively capture the complexities of traffic data over varying time horizons. Extensive evaluations on a large-scale real-world traffic dataset demonstrate the excellence of SLIT compared with existing competitive methods in both short- and long-term travel time predictions across various metrics. SLIT exhibits significant improvements in prediction results, particularly in short-term forecasting. Remarkable improvements are observed in SLIT, with enhancements of up to 9.67% in terms of all evaluation metrics across various time horizons. Furthermore, SLIT demonstrates the capability to analyze traffic patterns across various road complexities, proving its adaptability and effectiveness in diverse traffic scenarios with improvements of up to 10.83% in different road conditions. The results of this study highlight the high potential of SLIT in significantly enhancing traffic prediction within ITS.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Traffic Prediction and Management Techniques · Transportation Planning and Optimization · Traffic control and management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan
Institute of Information Management, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan
Department of Management Information Systems, National Chung Hsing University, Taichung 402, Taiwan
Funding
National Science and Technology Council of Taiwan
References (32)
Show source-provided references
1. A Deep Learning Approach for Long-Term Traffic Flow Prediction With Multifactor Fusion Using Spatiotemporal Graph Convolutional Network10.1109/TITS.2022.3201879 ↗
2. Repeatability and Similarity of Freeway Traffic Flow and Long-Term Prediction Under Big Data10.1109/TITS.2015.2511156 ↗
3. T2F-LSTM Method for Long-term Traffic Volume Prediction10.1109/TFUZZ.2020.2986995 ↗
4. Multisize Patched Spatial-Temporal Transformer Network for Short- and Long-Term Crowd Flow Prediction10.1109/TITS.2022.3186707 ↗
5. Periodic Attention-based Stacked Sequence to Sequence framework for long-term travel time prediction10.1016/j.knosys.2022.109976 ↗
6. Liu, Y., Wang, Y., Yang, X., and Zhang, L. (2017, January 16–19). Short-term travel time prediction by deep learning: A comparison of different LSTM-DNN models. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.10.1109/ITSC.2017.8317886 ↗
7. EnLSTM-WPEO: Short-Term Traffic Flow Prediction by Ensemble LSTM, NNCT Weight Integration, and Population Extremal Optimization10.1109/TVT.2019.2952605 ↗
8. Freeway Travel Time Prediction Using Deep Hybrid Model – Taking Sun Yat-Sen Freeway as an Example10.1109/TVT.2020.2999358 ↗
9. A recurrent neural network for urban long-term traffic flow forecasting10.1007/s10489-020-01716-1 ↗
10. A Hybrid Deep Learning Framework for Long-Term Traffic Flow Prediction10.1109/ACCESS.2021.3050836 ↗
11. A Multi-head Attention-based Transformer Model for Traffic Flow Forecasting with a Comparative Analysis to Recurrent Neural Networks10.1016/j.eswa.2022.117275 ↗
12. Jin, D., Shi, J., Wang, R., Li, Y., Huang, Y., and Yang, Y.B. (2023, January 22–25). Trafformer: Unify Time and Space in Traffic Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v37i7.25980 ↗
13. Oluwasanmi, A., Aftab, M.U., Qin, Z., Sarfraz, M.S., Yu, Y., and Rauf, H.T. (2023). Multi-head spatiotemporal attention graph convolutional network for traffic prediction. Sensors, 23.10.3390/s23083836 ↗
14. Mashurov, V., Chopurian, V., Porvatov, V., Ivanov, A., and Semenova, N. (2023). GCT-TTE: Graph Convolutional Transformer for Travel Time Estimation. arXiv.10.1186/s40537-023-00841-1 ↗
15. Jiang, J., Han, C., Zhao, W.X., and Wang, J. (2023, January 22–25). PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Prediction. Proceedings of the AAAI conference on artificial intelligence, Vancouver, BC, Canada.10.1609/aaai.v37i4.25556 ↗
16. Developing a time-series speed prediction model using Transformer networks for freeway interchange areas10.1016/j.compeleceng.2023.108860 ↗
17. Bidirectional Spatial-Temporal Adaptive Transformer for Urban Traffic Flow Forecasting10.1109/TNNLS.2022.3183903 ↗
18. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
19. Mingxing, X., Dai, W., Liu, C., Gao, X., Lin, W., Qi, G.J., and Xiong, H. (2020). Spatial-Temporal Transformer Networks for Traffic Flow Forecasting. arXiv.
20. Du, L., Xin, J., Labach, A., Zuberi, S., Volkovs, M., and Krishnan, R.G. (2023). MultiResFormer: Transformer with Adaptive Multi-Resolution Modeling for General Time Series Forecasting. arXiv.
21. TS-Fastformer: Fast Transformer for Time-series Forecasting
22. Chou, C., Huang, Y., Huang, C., and Tseng, V. (2019, January 14–17). Long-term traffic time prediction using deep learning with integration of weather effect. Proceedings of the Advances in Knowledge Discovery and Data Mining —23rd Pacific-Asia Conference, PAKDD 2019, Macau, China.10.1007/978-3-030-16145-3_10 ↗
23. Multivariate time series forecasting via attention-based encoder–decoder framework10.1016/j.neucom.2019.12.118 ↗
24. A temporal fusion transformer for short-term freeway traffic speed multistep prediction10.1016/j.neucom.2022.05.083 ↗
25. Lin, Y., Ge, L., Li, S., and Zeng, B. (2022, January 18–23). Prior Knowledge and Data-Driven Based Long- and Short-Term Fusion Network for Traffic Forecasting. Proceedings of the 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy.10.1109/IJCNN55064.2022.9892937 ↗
26. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
27. Freeway Bureau Taiwan R.O.C. (2021, March 10). Taiwan Expressway Dataset, Available online: https://tisvcloud.freeway.gov.tw.
28. Traffic Flow Forecasting: Comparison of Modeling Approaches10.1061/(ASCE)0733-947X(1997)123:4(261) ↗
29. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
30. Daily Long-Term Traffic Flow Forecasting Based on a Deep Neural Network10.1016/j.eswa.2018.12.031 ↗
31. Ruland, F. (2018). The Wilcoxon-Mann-Whitney Test—An Introduction to Nonparametrics, Independently Published.
32. Everitt, B., and Skrondal, A. (2010). The Cambridge Dictionary of Statistics, Cambridge University Press.10.1017/CBO9780511779633 ↗