journal article·2023-05-31Open access

An Approach to Guide the Search for Potentially Hazardous Scenarios for Autonomous Vehicle Safety Validation

Tchoya Florence Koné, Eric Bonjour, Eric Levrat, Frédérique Mayer, Stéphane Géronimi

Applied Sciences· Volume 13· Issue 11

Abstract

Safety validation of Autonomous Vehicles (AV) requires simulation. Automotive manufacturers need to generate scenarios used during this simulation-based validation process. Several approaches have been proposed to master scenario generation. However, none have proposed a method to measure the potential hazardousness of the scenarios with regard to the performance limitations of AV. In other words, there is no method offering a metric to guide the search for potentially critical scenarios within the infinite space of scenarios. However, designers have knowledge of the functional limitations of AV components depending on the situations encountered. The more sensitive the AV is to a situation, the more safety experts consider it to be critical. In this paper, we present a new method to help estimate the sensitivity of AV to logical situations and events before their use for the generation of concrete scenarios submitted to simulators. We propose a characterization of the inputs used for sensitivity analysis (definition of the context of the automation function, generation of functional and logical situations with their associated events). We then propose an approach to set up a distribution function that will make it possible to select situations and events according to their importance in terms of sensitivity. We illustrate this approach by implementing it on the Traffic Jam Chauffeur (TJC) function. Finally, we compare the obtained sensitivity rank with expert judgment to demonstrate its relevance. This approach has been shown to be a promising method to guide the search for potentially hazardous scenarios that are relevant to the simulation-based safety validation process for AV.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Safety Systems Engineering in Autonomy · Traffic control and management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Stellantis, Université Lorraine (FR), 54000 Nancy, France

Research Team on Innovative Processes (ERPI Laboratory), Université de Lorraine, 8 rue Bastien Lepage, 54000 Nancy, France

Research Centre for Automatic Control of Nancy (CRAN Laboratory UMR CNRS 7039), Université de Lorraine, 54506 Vandœuvre-lès-Nancy, France

Stellantis, 78140 Vélizy-Villacoublay, France

Funding

ANRT (the French National Association of Research and Technology · STELLANTIS (ex GROUPE PSA)

References (33)

Show source-provided references
1. (2011). Road Vehicles—Functional Safety (Standard No. ISO 26262).
2. (2022). Road Vehicles—Safety of the Intended Functionality (Standard No. ISO 21448).
3. Ponn, T., Muller, F., and Diermeyer, F. (2019). IEEE Intelligent Vehicles Symposium, Proceedings, IEEE.
4. Sensor Technology for Autonomous Vehicles10.1016/B978-0-12-822548-6.00122-9 ↗
5. Li, C., Sifakis, J., Wang, Q., Yan, R., and Zhang, J. (2023). Simulation-Based Validation for Autonomous Driving Systems, Association for Computing Machinery.10.1145/3597926.3598100 ↗
6. Kalra, N., and Paddock, S.M. (2014). Driving to Safety, RAND Corporation.
7. A Driver Behavior-Based Lane-Changing Model for Urban Arterial Streets10.1287/trsc.1120.0435 ↗
8. Thorn, E., Kimmel, S., and Chaka, M. (2023, May 27). A Framework for Automated Driving System Testable Cases and Scenarios. Report No. Dot Hs 812 623. 2018. p. 180, Available online: https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/13882-automateddrivingsystems_092618_v1a_tag.pdf.
9. Razzaq, S., Dar, A.R., Shah, M.A., Khattak, H.A., Ahmed, E., El-Sherbeeny, A.M., Lee, S.M., Alkhaledi, K., and Rauf, H.T. (2022). Multi-Factor Rear-End Collision Avoidance in Connected Autonomous Vehicles. Appl. Sci., 12.10.3390/app12031049 ↗
10. Riedmaier, S., Schneider, D., Watzenig, D., Diermeyer, F., and Schick, B. (2021). Model validation and scenario selection for virtual-based homologation of automated vehicles. Appl. Sci., 11.10.3390/app11010035 ↗
11. Survey on Scenario-Based Safety Assessment of Automated Vehicles10.1109/ACCESS.2020.2993730 ↗
12. Koné, T.F., Bonjour, E., Levrat, E., Mayer, F., and Géronimi, S. (2020). Complex Systems Design & Management, Springer International Publishing.
13. Menzel, T., Bagschik, G., and Maurer, M. (2018, January 26–30). Scenarios for Development, Test and Validation of Automated Vehicles. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.10.1109/IVS.2018.8500406 ↗
14. Jesenski, S., Stellet, J.E., Branz, W., and Zöllner, J.M. (2019, January 27–30). Simulation-Based Methods for Validation of Automated Driving: A Model-Based Analysis and an Overview about Methods for Implementation. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019, Auckland, New Zealand.10.1109/ITSC.2019.8917072 ↗
15. Amersbach, C., and Winner, H. (2019, January 27–30). Defining Required and Feasible Test Coverage for Scenario-Based Validation of Highly Automated Vehicles. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.10.1109/ITSC.2019.8917534 ↗
16. Reduced Complexity Safety Testing for ADAS & ADF
17. (2013). Software and Systems Engineering—Software Testing—Part 1: Concepts and Definitions (Standard No. ISO/IEC/IEEE 29119-1).
18. Adaptive intervention logic for automated driving systems based on injury risk minimization10.1177/0954407020931228 ↗
19. Alvarez, S., Page, Y., Sander, U., Fahrenkrog, F., Helmer, T., Jung, O., Hermitte, T., and Al, E. (2017, January 5–8). Prospective effectiveness assessment of adas and active safety systems via virtual simulation: A review of the current practices. Proceedings of the 25th International Technical Conference on the Enhanced Safety of Vehicles (ESV), Detroit, MI, USA.
20. Prospective and retrospective performance assessment of Advanced Driver Assistance Systems in imminent collision scenarios: The CMI-Vr approach10.1186/s12544-022-00527-4 ↗
21. Evaluation of a momentum based impact model in frontal car collisions for the prospective assessment of ADAS10.1186/s12544-018-0343-3 ↗
22. Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology10.1109/TITS.2020.2972211 ↗
23. Hallerbach, S., Xia, Y., Eberle, U., and Koester, F. (2018). SAE International Journal of Connected and Automated Vehicles, SAE International. SAE Technical Paper 2018-01-1066.
24. Mechanism reliability and sensitivity analysis method using truncated and correlated normal variables10.1016/j.ssci.2020.104615 ↗
25. Sensitivity analysis of driver’s behavior and psychophysical conditions10.1016/j.ssci.2019.104586 ↗
26. Xiong, Z. (2013). Creating a Computing Environment in a Driving Vehicles, The University of Leeds Institute for Transport Studies & School of Computing.
27. Concept and development of a unified ontology for generating test and use-case catalogues for assisted and automated vehicle guidance10.1049/iet-its.2012.0188 ↗
28. Ulbrich, S., Menzel, T., Reschka, A., Schuldt, F., and Maurer, M. (2015, January 15–18). Defining and Substantiating the Terms Scene, Situation, and Scenario for Automated Driving. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Gran Canaria, Spain.10.1109/ITSC.2015.164 ↗
29. Bagschik, G., Menzel, T., and Maurer, M. (2018, January 26–30). Ontology based Scene Creation for the Development of Automated Vehicles. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.10.1109/IVS.2018.8500632 ↗
30. Koné, T.F., Levrat, E., Bonjour, E., Mayer, F., and Géronimi, S. (2020, January 1–5). Safety assessment of scenarios for the simulation-based validation process of AV with regards to its functional insufficiencies. Proceedings of the 30th European Safety and Reliability Conference, ESREL 2020 and 15th Probabilistic Safety Assessment and Management Conference, PSAM, Venice, Italy.10.3850/978-981-14-8593-0_4067-cd ↗
31. A Study on Situation Analysis for ASIL Determination
32. Operational and System Hazard Analysis in a Safe Systems Requirement Engineering Process-Application to automotive industry10.1016/j.ssci.2016.04.011 ↗
33. Rocklage, E. (2017, January 16–19). Teaching self-driving cars to dream: A deeply integrated, innovative approach for solving the autonomous vehicle validation problem. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Proceedings (ITSC), Yokohama, Japan.10.1109/ITSC.2017.8317918 ↗