journal article·2024-11-13Open access

Complexity Evaluation for Urban Intersection Scenarios in Autonomous Driving Tests: Method and Validation

Jiangkun Li, Ruixue Zong, Ying Wang, Weiwen Deng

Applied Sciences· Volume 14· Issue 22

Abstract

As autonomous driving technology scales up, complex urban intersections pose significant safety challenges. Current testing methods struggle to simulate these complex scenarios at a manageable cost, making simulation testing essential. For effective evaluation, establishing comprehensive and objective complexity metrics is crucial. However, existing complexity evaluation methods often depend on the performance of the primary vehicle and are based on local interaction relationships, which lack a global perspective and objectivity and have yet to be validated by autonomous driving systems. To address this issue, this paper proposes a multidimensional complexity assessment framework that introduces system-level indicators such as vehicle count, interaction density, disorder, and risk. This framework quantifies the complex interactions at intersections from a global perspective, independent of primary vehicle performance. Experimental results demonstrate that the complexity evaluation results are highly consistent with the performance of a high-level autonomous driving system (Apollo). The framework has been successfully applied to test scenario generation on the Apollo platform, achieving twice the scenario generation efficiency of traditional methods, thus showcasing substantial engineering value.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Traffic control and management · Traffic and Road Safety

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Transportation Science and Engineering, Beihang University, Beijing 100191, China

College of Computer Science and Technology, Jilin Univerisity, Changchun 130025, China

Funding

“Lingyan” R&D Program of Zhejiang Province · “Jianbing” R&D Program of Zhejiang Province · Jilin Provinice Science and Technology Project

References (42)

Show source-provided references
1. Future Transport Vision Propensity Segments: A Latent Class Analysis of Autonomous Taxi Market10.1016/j.tra.2023.103699 ↗
2. Autonomous Vehicle Market Development in Beijing: A System Dynamics Approach10.1016/j.tra.2023.103889 ↗
3. Li, J., Deng, W., Wang, Y., Wang, J., and Ding, J. (2024). Modeling of Complex Traffic Interaction Under Uncontrolled Intersection Scenario. IEEE Trans. Intell. Veh., Early Access.10.1109/TIV.2024.3407058 ↗
4. Tian, C., Victor Chan, W.K., and Zhang, Y. (2020, January 14–18). Pedestrian Behavior at Intersections: A Literature Review of Models and Simulation Recommendations. Proceedings of the 2020 Winter Simulation Conference (WSC), Orlando, FL, USA.10.1109/WSC48552.2020.9384128 ↗
5. Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., and Fujimura, K. (2018, January 21–25). Navigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8461233 ↗
6. Castellano, E., Cetinkaya, A., and Arcaini, P. (2021, January 6–10). Analysis of Road Representations in Search-Based Testing of Autonomous Driving Systems. Proceedings of the 2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS), Hainan, China.10.1109/QRS54544.2021.00028 ↗
7. Karunakaran, D., Berrio, J.S., Worrall, S., and Nebot, E. (2022, January 2–4). Challenges Of Testing Highly Automated Vehicles: A Literature Review. Proceedings of the 2022 IEEE International Conference on Recent Advances in Systems Science and Engineering (RASSE), Tainan, Taiwan.10.1109/RASSE54974.2022.9989562 ↗
8. Safety Testing of Automated Driving Systems: A Literature Review10.1109/ACCESS.2023.3327918 ↗
9. Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology10.1109/TITS.2020.2972211 ↗
10. Testing Scenario Library Generation for Connected and Automated Vehicles, Part II: Case Studies10.1109/TITS.2020.2988309 ↗
11. Traffic Modeling Based on Data-Driven Method for Simulation Test of Autonomous Driving10.1109/TITS.2023.3304972 ↗
12. Safety Assessment of Highly Automated Driving Systems in Test Tracks: A New Framework10.1016/j.aap.2020.105664 ↗
13. Waymo Simulated Driving Behavior in Reconstructed Fatal Crashes within an Autonomous Vehicle Operating Domain10.1016/j.aap.2021.106454 ↗
14. Autonomous Driving Testing Scenario Generation Based on In-Depth Vehicle-to-Powered Two-Wheeler Crash Data in China10.1016/j.aap.2022.106812 ↗
15. Dynamic Driving Environment Complexity Quantification Method and Its Verification10.1016/j.trc.2021.103051 ↗
16. A Mathematical Theory of Communication10.1002/j.1538-7305.1948.tb01338.x ↗
17. An Entropy-Based Model for Quantifying Multi-Dimensional Traffic Scenario Complexity10.1049/itr2.12510 ↗
18. A Theoretical Foundation for the Gravity Equation
19. Garau Guzman, J., and Baeza, V.M. (2024). Enhancing Urban Mobility through Traffic Management with UAVs and VLC Technologies. Drones, 8.10.3390/drones8010007 ↗
20. Li, L., An, B., Zhang, D., Gan, R., Zhou, Z., Qu, X., and Ran, B. (2024). Vehicular Speed Prediction Method for Highway Scenarios Based on Spatio-Temporal Graph Convolutional Networks and Potential Field Theory. IEEE Internet Things J., early access.10.1109/JIOT.2024.3479221 ↗
21. Zhang, L., Zhang, S., Liu, X., and Chen, Z. (2024, January 25–27). Sustainable Traffic Management: A Framework Utilizing Energy Consumption Patterns. Proceedings of the 2024 International Conference on Electrical, Computer and Energy Technologies (ICECET, Sydney, Australia.10.1109/ICECET61485.2024.10698234 ↗
22. Klöppel-Gersdorf, M., and Otto, T. (2024, January 2–4). Using V2X-Information for Trajectory Prediction at Urban Intersections. Proceedings of the International Conference on Vehicle Technology and Intelligent Transport Systems 2024, Angers, France.10.5220/0012735600003702 ↗
23. Liu, L., Gao, Z., Luo, P., Duan, W., Hu, M., Mohd Arif Zainol, M.R.R., and Zawawi, M.H. (2023). The Influence of Visual Landscapes on Road Traffic Safety: An Assessment Using Remote Sensing and Deep Learning. Remote Sens., 15.10.3390/rs15184437 ↗
24. Intersection Complexity and Its Influence on Human Drivers10.1109/ACCESS.2022.3189017 ↗
25. A Complex Junction Recognition Method Based on GoogLeNet Model10.1111/tgis.12681 ↗
26. Yang, J., Zhao, K., Li, M., Xu, Z., and Li, Z. (2021). Identifying Complex Junctions in a Road Network. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10010004 ↗
27. The Analytic Hierarchy Process—What It Is and How It Is Used10.1016/0270-0255(87)90473-8 ↗
28. Lu, Z., and Kongjian, Q. (2023, January 15–17). Research on the Complexity Evaluation Method for Autonomous Driving Test Scenarios Based on Improved-Delphi Method and AHP-Entropy Weighting Model. Proceedings of the 2023 IEEE 7th Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China.10.1109/ITOEC57671.2023.10291212 ↗
29. Wang, Y., Li, K., Hu, Y., and Chen, H. (2020, January 22–24). Modeling and Quantitative Assessment of Environment Complexity for Autonomous Vehicles. Proceedings of the 2020 Chinese Control And Decision Conference (CCDC), Hefei, China.10.1109/CCDC49329.2020.9164239 ↗
30. Research on the Quantitative Evaluation of the Traffic Environment Complexity for Unmanned Vehicles in Urban Roads10.1109/ACCESS.2021.3054882 ↗
31. Liu, W., Chen, Y., Li, H., and Zhang, H. (2022). Quantitative Study on Road Traffic Environment Complexity under Car-Following Condition. Sustainability, 14.10.3390/su14106251 ↗
32. Wei, Z., Zhou, H., and Zhou, R. (2024). Risk and Complexity Assessment of Autonomous Vehicle Testing Scenarios. Appl. Sci., 14.10.3390/app14219866 ↗
33. Zhang, L., Sun, H., and Li, Z. Scenario Complexity Evaluation Method Of Intelligent Driving Real Road Test Based On Operational Design Condition. Proceedings of the 2024 Asia Pacific Conference on Computing Technologies, Communications and Networking CTCNet ’24.10.1145/3685767.3687087 ↗
34. Peng, J., Mei, X., Li, W., Hong, L., Sun, B., and Li, H. (2021). Scene Complexity: A New Perspective on Understanding the Scene Semantics of Remote Sensing and Designing Image-Adaptive Convolutional Neural Networks. Remote Sens., 13.10.3390/rs13040742 ↗
35. A Crack-Segmentation Algorithm Fusing Transformers and Convolutional Neural Networks for Complex Detection Scenarios10.1016/j.autcon.2023.104894 ↗
36. Li, G., Chen, J., Wang, K., Long, Y., and Xiong, Z. (2019, January 14–15). A Model Evaluating Complexity of Driving Environment toward Autonomous Vehicles Using Neural Network. Proceedings of the 2019 12th International Symposium on Computational Intelligence and Design (ISCID), Hangzhou, China.10.1109/ISCID.2019.00055 ↗
37. Zhang, C., Eskandarian, A., and Du, X. (2021, January 19–22). Attention-Based Neural Network for Driving Environment Complexity Perception. Proceedings of the 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA.10.1109/ITSC48978.2021.9564709 ↗
38. Zhang, L., Ma, Y., Xing, X., Xiong, L., and Chen, J. (2021, January 19–22). Research on the Complexity Quantification Method of Driving Scenarios Based on Information Entropy. Proceedings of the 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA.10.1109/ITSC48978.2021.9565025 ↗
39. Complexity of Driving Scenarios Based on Traffic Accident Data10.1007/s12239-024-00004-y ↗
40. Scalable Evaluation Methods for Autonomous Vehicles10.1016/j.eswa.2024.123603 ↗
41. Cheng, Y., Liu, Z., Gao, L., Zhao, Y., and Gao, T. (2022). Traffic Risk Environment Impact Analysis and Complexity Assessment of Autonomous Vehicles Based on the Potential Field Method. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph191610337 ↗
42. Curzio, A.Q., and Fortis, M. What Is Complexity?. Proceedings of the Complexity and Industrial Clusters.