Pedestrian Trajectory Prediction Based on Dual Social Graph Attention Network
Source abstract
Abstract
Pedestrian trajectory prediction poses significant challenges for autonomous systems due to the intricate nature of social interactions in densely populated environments. While the existing methods frequently encounter difficulties in effectively quantifying the nuanced social relationships, we propose a novel dual social graph attention network (DSGAT) that systematically models multi-level interactions. This framework is specifically designed to enhance the extraction of pedestrian interaction features within the environment, thereby improving the trajectory prediction accuracy. The network architecture consists of two primary branches, namely an individual branch and a group branch, which are responsible for modeling personal and collective pedestrian behaviors, respectively. For individual feature modeling, we propose the Spatio-Temporal Weighted Graph Attention Network (STWGAT) branch, which incorporates a newly developed directed social attention function to explicitly capture both the direction and intensity of pedestrian interactions. This mechanism enables the model to more effectively represent the fine-grained social dynamics. Subsequently, leveraging the STWGAT’s processing of directed weighted graphs, the network’s ability to aggregate spatiotemporal information and refine individual interaction representations is further strengthened. To effectively account for the critical group dynamics, a dedicated group attention function is designed to identify and quantify the collective behaviors within pedestrian crowds. This facilitates a more comprehensive understanding of the complex social interactions, leading to an enhanced trajectory prediction accuracy. Extensive comparative experiments conducted on the widely used ETH and UCY benchmark datasets demonstrate that the proposed network consistently surpasses the baseline methods across the key evaluation metrics, including the Average Displacement Error (ADE) and Final Displacement Error (FDE). These results confirm the effectiveness and robustness of the DSGAT-based approach in handling complex pedestrian interaction scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Traffic Prediction and Management Techniques · Traffic and Road Safety · Autonomous Vehicle Technology and Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Key Laboratory of Advanced Manufacturing and Automation Technology, Education Department of Guangxi Zhuang Autonomous Region, Guilin 541006, China
College of Mechanical and Control Engineering, Guilin University of Technology, Guilin 541006, China
References (41)
Show source-provided references
1. Pedestrian Behavior Prediction Using Deep Learning Methods for Urban Scenarios: A Review10.1109/TITS.2023.3281393 ↗
2. Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review10.1109/TITS.2023.3291196 ↗
3. Social Force Model for Pedestrian Dynamics10.1103/PhysRevE.51.4282 ↗
4. BRVO: Predicting Pedestrian Trajectories Using Velocity-Space Reasoning10.1177/0278364914555543 ↗
5. Jiang, J., Yan, K., Xia, X., and Yang, B. (2025). A Survey of Deep Learning-Based Pedestrian Trajectory Prediction: Challenges and Solutions. Sensors, 25.10.3390/s25030957 ↗
6. Sighencea, B.I., Stanciu, R.I., and Căleanu, C.D. (2021). A Review of Deep Learning-Based Methods for Pedestrian Trajectory Prediction. Sensors, 21.10.3390/s21227543 ↗
7. Soft + Hardwired attention: An LSTM framework for human trajectory prediction and abnormal event detection10.1016/j.neunet.2018.09.002 ↗
8. Leon, F., and Gavrilescu, M. (2021). A Review of Tracking and Trajectory Prediction Methods for Autonomous Driving. Mathematics, 9.10.3390/math9060660 ↗
9. Shao, L., Ling, M., Yan, Y., Xiao, G., Luo, S., and Luo, Q. (2024). Research on Vehicle-Driving-Trajectory Prediction Methods by Considering Driving Intention and Driving Style. Sustainability, 16.10.3390/su16198417 ↗
10. Shi, L., Wang, L., Long, C., Zhou, S., Zhou, M., Niu, Z., and Hua, G. (2021, January 20–25). SGCN: Sparse Graph Convolution Network for Pedestrian Trajectory Prediction. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00888 ↗
11. Huang, Y., Bi, H., Li, Z., Mao, T., and Wang, Z. (November, January 27). STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory Prediction. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.00637 ↗
12. Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., and Savarese, S. (2016, January 27–30). Social LSTM: Human trajectory prediction in crowded spaces. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.110 ↗
13. Xue, H., Huynh, D.Q., and Reynolds, M. (2018, January 12–15). SS-LSTM: A Hierarchical LSTM Model for Pedestrian Trajectory Prediction. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00135 ↗
14. Hasan, I., Setti, F., Tsesmelis, T., Bue, A.D., Cristani, M., and Galasso, F. (2018, January 12–15). “Seeing is believing”: Pedestrian trajectory forecasting using visual frustum of attention. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00134 ↗
15. A Novel Graph-Based Trajectory Predictor with Pseudo-Oracle10.1109/TNNLS.2021.3084143 ↗
16. Sun, J., Jiang, Q., and Lu, C. (2020, January 13–19). Recursive Social Behavior Graph for Trajectory Prediction. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00074 ↗
17. Dual-Branch Spatio-Temporal Graph Neural Networks for Pedestrian Trajectory Prediction10.1016/j.patcog.2023.109633 ↗
18. Ellis, D., Sommerlade, E., and Reid, I. (October, January 27). Modelling pedestrian trajectory patterns with Gaussian processes. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Kyoto, Japan.10.1109/ICCVW.2009.5457470 ↗
19. MTMGNN: Multi-time multi-graph neural network for metro passenger flow prediction10.1007/s10707-022-00466-1 ↗
20. Investigating ride sharing opportunities through mobility data analysis10.1016/j.pmcj.2014.05.010 ↗
21. Cavallaro, C., Verga, G., Tramontana, E., and Muscato, O. (2019, January 26–28). Multi-Agent Architecture for Point of Interest Detection and Recommendation. Proceedings of the CEUR Workshop Proceedings, Parma, Italy.
22. Multi-dimensional spatiotemporal demand forecasting and service vehicle dispatching for online car-hailing platforms10.1080/00207543.2021.1871675 ↗
23. When Will We Arrive? A Novel Multi-Task Spatio-Temporal Attention Network Based on Individual Preference for Estimating Travel Time10.1109/TITS.2023.3276916 ↗
24. Zong, M., Chang, Y., Dang, Y., and Wang, K. (2024). Pedestrian Trajectory Prediction in Crowded Environments Using Social Attention Graph Neural Networks. Appl. Sci., 14.10.3390/app14209349 ↗
25. CoL-GAN: Plausible and Collision-Less Trajectory Prediction by Attention-Based GAN10.1109/ACCESS.2020.2987072 ↗
26. BR-GAN: A Pedestrian Trajectory Prediction Model Combined with Behavior Recognition10.1109/TITS.2022.3193442 ↗
27. Dou, W., and Lu, L. (2024). SISGAN: A Generative Adversarial Network Pedestrian Trajectory Prediction Model Combining Interaction Information and Scene Information. Appl. Sci., 14.10.3390/app14209537 ↗
28. Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., and Alahi, A. (2018, January 18–23). Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00240 ↗
29. CSR: Cascade Conditional Variational Auto Encoder with Socially-aware Regression for Pedestrian Trajectory Prediction10.1016/j.patcog.2022.109030 ↗
30. CSIR: Cascaded Sliding CVAEs with Iterative Socially-Aware Rethinking for Trajectory Prediction10.1109/TITS.2023.3300730 ↗
31. Mohamed, A., Qian, K., Elhoseiny, M., and Claudel, C. (2020, January 13–19). Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Prediction. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01443 ↗
32. Kipf, T.N., and Welling, M. (2017, January 24–26). Semi-supervised classification with graph convolutional networks. Proceedings of the International Conference on Learning Representations, Toulon, France.
33. Petar, V., Cucurull, G., Casanova, A., Romero, A., Pietro, L., and Bengio, Y. (May, January 30). Graph Attention Networks. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada.
34. STM-GCN: A Spatiotemporal Multi-Graph Convolutional Network for Pedestrian Trajectory Prediction10.1007/s11227-023-05467-x ↗
35. Sighencea, B.I., Stanciu, I.R., and Căleanu, C.D. (2023). D-STGCN: Dynamic Pedestrian Trajectory Prediction Using Spatio-Temporal Graph Convolutional Networks. Electronics, 12.10.3390/electronics12030611 ↗
36. Social-bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks
37. Grassia, M., and Mangioni, G. (2022). wsGAT: Weighted and Signed Graph Attention Networks for Link Prediction. Complex Networks & Their Applications X: Volume 1, Proceedings of the Tenth International Conference on Complex Networks and Their Applications, Springer.10.1007/978-3-030-93409-5_31 ↗
38. Pellegrini, S., Ess, A., and Van Gool, L. (2010, January 5–11). Improving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings. Proceedings of the 11th European Conference on Computer Vision, Heraklion, Greece.10.1007/978-3-642-15549-9_33 ↗
39. Crowds by example10.1111/j.1467-8659.2007.01089.x ↗
40. Amir, S., Vineet, K., Ali, S., Noriaki, H., Hamid, R., and Silvio, S. (2019, January 15–20). Sophie: An attentive gan for predicting paths compliant to social and physical constraints. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.
41. Sekhon, J., and Fleming, C. (2021, January 2–9). SCAN: A Spatial Context Attentive Network for Joint Multi-Agent Intent Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.10.1609/aaai.v35i7.16762 ↗