journal article·2024-05-15Open access

Expressway Vehicle Trajectory Prediction Based on Fusion Data of Trajectories and Maps from Vehicle Perspective

Yuning Duan, Jingdong Jia, Yuhui Jin, Haitian Zhang, Jian Huang

Applied Sciences· Volume 14· Issue 10

Abstract

Research on vehicle trajectory prediction based on road monitoring video data often utilizes a global map as an input, disregarding the fact that drivers rely on the road structures observable from their own positions for path planning. This oversight reduces the accuracy of prediction. To address this, we propose the CVAE-VGAE model, a novel trajectory prediction approach. Initially, our method transforms global perspective map data into vehicle-centric map data, representing it through a graph structure. Subsequently, Variational Graph Auto-Encoders (VGAEs), an unsupervised learning framework tailored for graph-structured data, are employed to extract road environment features specific to each vehicle’s location from the map data. Finally, a prediction network based on the Conditional Variational Autoencoder (CVAE) structure is designed, which first predicts the driving endpoint and then fits the complete future trajectory. The proposed CVAE-VGAE model integrates a self-attention mechanism into its encoding and decoding modules to infer endpoint intent and incorporate road environment features for precise trajectory prediction. Through a series of ablation experiments, we demonstrate the efficacy of our method in enhancing vehicle trajectory prediction metrics. Furthermore, we compare our model with traditional and frontier approaches, highlighting significant improvements in prediction accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Time Series Analysis and Forecasting · Traffic Prediction and Management Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Software, Beihang University, Beijing 100191, China

Hangzhou International Innovation Institute, Beihang University, Beijing 100191, China

Funding

2022–2025 National Key Research and Development Program of China

References (35)

Show source-provided references
1. Abduljabbar, R., Dia, H., Liyanage, S., and Bagloee, S.A. (2019). Applications of artificial intelligence in transport: An overview. Sustainability, 11.10.3390/su11010189 ↗
2. Vehicle Trajectory Prediction in Expressway Merging Areas Based on Self-Supervised Mechanism10.1061/JTEPBS.TEENG-8176 ↗
3. Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., and Alahi, A. (2018, January 18–23). Social gan: Socially acceptable trajectories with generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00240 ↗
4. Rhinehart, N., McAllister, R., Kitani, K., and Levine, S. (November, January 27). Precog: Prediction conditioned on goals in visual multi-agent settings. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
5. Barth, A., and Franke, U. (2008, January 4–6). Where will the oncoming vehicle be the next second?. Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands.10.1109/IVS.2008.4621210 ↗
6. Houenou, A., Bonnifait, P., Cherfaoui, V., and Yao, W. (2013, January 3–7). Vehicle trajectory prediction based on motion model and maneuver recognition. Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.10.1109/IROS.2013.6696982 ↗
7. Danielsson, S., Petersson, L., and Eidehall, A. (2007, January 13–15). Monte carlo based threat assessment: Analysis and improvements. Proceedings of the 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey.10.1109/IVS.2007.4290120 ↗
8. Tomar, R.S., Verma, S., and Tomar, G.S. (2010, January 26–28). Prediction of lane change trajectories through neural network. Proceedings of the 2010 International Conference on Computational Intelligence and Communication Networks, Bhopal, India.10.1109/CICN.2010.59 ↗
9. An interacting multiple model for trajectory prediction of intelligent vehicles in typical road traffic scenario10.1109/TNNLS.2021.3136866 ↗
10. Kordmahalleh, M.M., Sefidmazgi, M.G., and Homaifar, A. (2016, January 20–24). A Sparse Recurrent Neural Network for Trajectory Prediction of Atlantic Hurricanes. Proceedings of the Genetic and Evolutionary Computation Conference, Denver, CO, USA.
11. Pool, E.A.I., Kooij, J.F.P., and Gavrila, D.M. (2019, January 9–12). Context-based cyclist path prediction using Recurrent Neural Networks. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.10.1109/IVS.2019.8813889 ↗
12. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network10.1016/j.physd.2019.132306 ↗
13. Altché, F., and de La Fortelle, A. (2017, January 16–19). An LSTM network for highway trajectory prediction. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.10.1109/ITSC.2017.8317913 ↗
14. Park, S.H., Kim, B., Kang, C.M., Chung, C.C., and Choi, J.W. (2018, January 26–30). Sequence-to-sequence prediction of vehicle trajectory via LSTM encoder-decoder architecture. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.10.1109/IVS.2018.8500658 ↗
15. Modeling vehicle interactions via modified LSTM models for trajectory prediction10.1109/ACCESS.2019.2907000 ↗
16. Vehicle trajectory prediction by knowledge-driven LSTM network in urban environments
17. Generative adversarial networks10.1145/3422622 ↗
18. Lee, N., Choi, W., Vernaza, P., Choy, C.B., Torr, P.H., and Chandraker, M. (2017, January 21–26). Desire: Distant future prediction in dynamic scenes with interacting agents. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.233 ↗
19. Attention is all you need
20. Liu, Y., Zhang, J., Fang, L., Jiang, Q., and Zhou, B. (2021, January 20–25). Multimodal motion prediction with stacked transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00749 ↗
21. Vehicle trajectory prediction based on intention-aware non-autoregressive transformer with multi-attention learning for Internet of Vehicles
22. SCViT: A spatial-channel feature preserving vision transformer for remote sensing image scene classification
23. Trajectory prediction for autonomous driving using spatial-temporal graph attention transformer10.1109/TITS.2022.3164450 ↗
24. Predictive trajectory planning for autonomous vehicles at intersections using reinforcement learning10.1016/j.trc.2023.104063 ↗
25. Deep learning driven visual path prediction from a single image10.1109/TIP.2016.2613686 ↗
26. Bansal, M., Krizhevsky, A., and Ogale, A. (2018). Chauffeurnet: Learning to drive by imitating the best and synthesizing the worst. arXiv.10.15607/RSS.2019.XV.031 ↗
27. Environment-attention network for vehicle trajectory prediction10.1109/TVT.2021.3111227 ↗
28. Gao, J., Sun, C., Zhao, H., Shen, Y., Anguelov, D., Li, C., and Schmid, C. (2020, January 13–19). Vectornet: Encoding hd maps and agent dynamics from vectorized representation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01154 ↗
29. Mangalam, K., Girase, H., Agarwal, S., Lee, K.-H., Adeli, E., Malik, J., and Gaidon, A. (2020, January 23–28). It is not the journey but the destination: Endpoint conditioned trajectory prediction. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK. Part II 16.10.1007/978-3-030-58536-5_45 ↗
30. Wilson, B., Qi, W., Agarwal, T., Lambert, J., Singh, J., Khandelwal, S., Pan, B., Kumar, R., Hartnett, A., and Pontes, J.K. (2023). Argoverse 2: Next generation datasets for self-driving perception and forecasting. arXiv.
31. Liang, M., Yang, B., Hu, R., Chen, Y., Liao, R., Feng, S., and Urtasun, R. (2020, January 23–28). Learning lane graph representations for motion forecasting. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK. Part II 16.10.1007/978-3-030-58536-5_32 ↗
32. Gu, J., Sun, C., and Zhao, H. (2021, January 11–17). Densetnt: End-to-end trajectory prediction from dense goal sets. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01502 ↗
33. Ngiam, J., Caine, B., Vasudevan, V., Zhang, Z., Chiang, H.-T.L., Ling, J., Roelofs, R., Bewley, A., Liu, C., and Venugopal, A. (2021). Scene transformer: A unified architecture for predicting multiple agent trajectories. arXiv.
34. Gilles, T., Sabatini, S., Tsishkou, D., Stanciulescu, B., and Moutarde, F. (2021). Thomas: Trajectory heatmap output with learned multi-agent sampling. arXiv.
35. Dynamic scenario representation learning for motion forecasting with heterogeneous graph convolutional recurrent networks10.1109/LRA.2023.3262150 ↗