journal article·2023-12-24Open access

Quantitative Testing and Analysis of Non-Standard AEB Scenarios Extracted from Corner Cases

Renhao Rao, Changcai Cui, Liang Chen, Tianfang Gao, Yuan Shi

Applied Sciences· Volume 14· Issue 1

Abstract

Existing testing methods for Automatic Emergency Braking (AEB) systems mostly rely on standard-based qualitative analysis of specific scenarios, with a focus on whether collisions occur. To explore scenarios beyond the standard conduct, a comprehensive testing model construction and analysis, and provide a more quantitative evaluation of AEB performance, this study extracted three typical hazardous driving scenarios from the KITTI (The Automated Driving dataset was created by the Karlsruhe Institute of Technology in Germany and the Toyota Institute of Technology in the United States) naturalistic driving dataset using kinematic data. A DME (Data Missing Estimation) scene construction method was proposed, and these scenarios were simulated and reconstructed in PRESCAN (PRESCAN is an automotive simulation software owned by Siemens, Munich, Germany). A C-AEB (Curve-Automatic Emergency Braking) testing model was developed and tested based on simulations. Finally, a BCEM (Boundary collision evaluation model) was proposed to quantitatively evaluate AEB performance. The focus of the analysis was on the identified cornering scenario A (severely failed AEB scenario). A C-AEB testing model was constructed based on the DME scene construction method for this cornering AEB failure scenario, and it was evaluated using the BCEM. The study found that the average performance degradation rate (performance degradation rate refers to the ratio of AEB performance in the current scenario compared to the standard straightaway test) of the AEB system in this cornering scenario reached 75.44%, with a maximum performance degradation rate of 89.47%. It was also discovered that the severe failure of AEB in this cornering scenario was mainly caused by sensor system perception defects and limitations of traditional AEB algorithms. This fully demonstrates the effectiveness of our testing and evaluation methodology.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Traffic and Road Safety · Traffic control and management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Manufacturing Engineering, Huaqiao University, Xiamen 361021, China

National and Local Joint Engineering Research Center for Intelligent Manufacturing Technology of Brittle Material Products, Xiamen 361021, China

Motor Vehicle Quality Supervision and Inspection Center, Xiamen Institute of Product Quality Supervision and Inspection, Xiamen 361004, China

Funding

Liang Chen, Tianfang Gao, Yuan Shi · Changcai Cui

References (29)

Show source-provided references
1. Research progress on scenario-based virtual testing for autonomous driving vehicles
2. Kyng, M. (1995). Scenario-Based Design: Envisioning Work and Technology in System Development, John Wiley & Sons, Inc.
3. Test scenarios construction based on a combinatorial testing strategy for automated vehicles10.1109/ACCESS.2021.3103912 ↗
4. A principled design for an integrated computational environment10.1207/s15327051hci0101_1 ↗
5. Formal approach to scenario analysis10.1109/52.268953 ↗
6. Wu, L., He, W., Liu, B., Han, X., and Tang, L. (2018, January 16–20). Scenario-based software reliability testing and evaluation of complex information systems. Proceedings of the 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C), Lisbon, Portugal.10.1109/QRS-C.2018.00027 ↗
7. Schieben, A., Heesen, M., Schindler, J., Kelsch, J., and Flemisch, F. (2009, January 21–22). The theater-system technique: Agile designing and testing of system behavior and interaction, applied to highly automated vehicles. Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Essen, Germany.10.1145/1620509.1620517 ↗
8. Elrofai, H., Worm, D., and Op den Camp, O. (2016). Advanced Microsystems for Automotive Applications 2016: Smart Systems for the Automobile of the Future, Springer International Publishing.
9. Automated support for modeling OO software10.1109/52.646888 ↗
10. Menzel, T., Bagschik, G., and Maurer, M. (2018, January 26–30). Scenarios for development, test and validation of automated vehicles. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.10.1109/IVS.2018.8500406 ↗
11. Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16–21). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of the 2012 IEEE conference on computer vision and pattern recognition, Providence, RI, USA.10.1109/CVPR.2012.6248074 ↗
12. Zhang, Y., Antonsson, E.K., and Grote, K. (2006, January 17–20). A new threat assessment measure for collision avoidance systems. Proceedings of the 2006 IEEE Intelligent Transportation Systems Conference, Toronto, ON, Canada.
13. Collision risk assessment algorithm via lane-based probabilistic motion prediction of surrounding vehicles10.1109/TITS.2017.2768318 ↗
14. Li, Y., Zhang, L., and Song, Y. (2016, January 13–15). A vehicular collision warning algorithm based on the time-to-collision estimation under connected environment. Proceedings of the 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), Phuket, Thailand.10.1109/ICARCV.2016.7838789 ↗
15. Model-based threat assessment for avoiding arbitrary vehicle collisions10.1109/TITS.2010.2048314 ↗
16. Human driving the data-based design of a vehicle adaptive cruise control algorithm10.1080/00423110701576130 ↗
17. Design of a haptic gas pedal for active car-following support10.1109/TITS.2010.2091407 ↗
18. Wang, J., Xiao, Q., and Chi, R. (2012). Proceedings of the 7th China Intelligent Transportation Annual Conference, Publishing House of Electronics Industry.
19. Driver headway: How close is too close on a motorway?10.1080/00140130701318665 ↗
20. Identification of visual cues and quantification of drivers’ perception of proximity risk to the lead vehicle in car-following situations10.1299/jmtl.1.170 ↗
21. Driving risk assessment using near-crash database through data mining of tree-based model10.1016/j.aap.2015.07.007 ↗
22. Satzoda, R.K., Gunaratne, P., and Trivedi, M.M. (July, January 28). Drive quality analysis of lane change maneuvers for naturalistic driving studies. Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Republic of Korea.10.1109/IVS.2015.7225759 ↗
23. Graded warning for rear-end collision: An artificial intelligence-aided algorithm10.1109/TITS.2019.2897687 ↗
24. Shalev-Shwartz, S., Shammah, S., and Shashua, A. (2017). On a formal model of safe and scalable self-driving cars. arXiv.
25. Potential risk assessment of the following scenarios based on natural driving data
26. Li, H., and Hartley, R. (2006, January 20–24). Five-point motion estimation made easy. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.
27. Vision meets robotics: The KITTI dataset10.1177/0278364913491297 ↗
28. Analysis of car-cyclist accident scenarios for autonomous driving vehicles
29. (2011). Code for the Design of Urban Road Traffic Facilities (Standard No. GB 50688-2011).